GitHub

RefineBench: Evaluating Refinement Capability of Language Models via Checklists

👋 Welcome to RefineBench — a comprehensive evaluation library for testing refinement capabilities of language models across multiple settings and domains. To reproduce the full results reported in ...

Forget 'debloat apps.' Sophia Script gives you real control over Windows 11. Here's how it works.

The Sophia Script is an open-source PowerShell module designed to debloat and fine-tune Windows 11 (and Windows 10 ). It is ...
IEEE

AdaCoder: An Adaptive Planning and Multi-Agent Framework for Function-Level Code Generation

Abstract: Recently, researchers have proposed many multi-agent frameworks for function-level code generation, which aim to improve software development productivity by automatically generating ...
InfoWorld

How to choose the best LLM using R and vitals

Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...
Federal Register

Voluntary Quality Management Maturity Prototype Assessment Protocol Evaluation Program

This document has been published in the Federal Register. Use the PDF linked in the document sidebar for the official electronic format.
IEEE

HumanEvo: An Evolution-Aware Benchmark for More Realistic Evaluation of Repository-Level Code Generation

Abstract: To evaluate the repository-level code generation capabilities of Large Language Models (LLMs) in complex real-world software development scenarios, many evaluation methods have been ...