SOTAVerified

HumanEval

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 264 papers

TitleStatusHype
Turning the Tide: Repository-based Code Reflection—0
Rethinking Verification for LLM Code Generation: From Generation to TestingCode1
any4: Learned 4-bit Numeric Representation for LLMsCode2
SACL: Understanding and Combating Textual Bias in Code Retrieval with Semantic-Augmented Reranking and Localization—0
Plan for Speed -- Dilated Scheduling for Masked Diffusion Language Models—0
AgentGroupChat-V2: Divide-and-Conquer Is What LLM-Based Multi-Agent System NeedCode0
LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing—0
Guaranteed Guess: A Language Modeling Approach for CISC-to-RISC Transpilation with Testing Guarantees—0
Guideline Forest: Experience-Induced Multi-Guideline Reasoning with Stepwise Aggregation—0
SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation—0
Enhancing LLM-Based Code Generation with Complexity Metrics: A Feedback-Driven Approach—0
Actor-Critic based Online Data Mixing For Language Model Pre-Training—0
Self-Correcting Code Generation Using Small Language ModelsCode0
An LLM-as-Judge Metric for Bridging the Gap with Human Evaluation in SE Tasks—0
Evaluating Large Language Models for Code Review—0
LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models—0
From Output to Evaluation: Does Raw Instruction-Tuned Code LLMs Output Suffice for Fill-in-the-Middle Code Generation?—0
Prior Prompt Engineering for Reinforcement Fine-Tuning—0
Invisible Entropy: Towards Safe and Efficient Low-Entropy LLM WatermarkingCode1
Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained SettingsCode0
HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM SystemsCode1
Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models—0
Rethinking Repetition Problems of LLMs in Code GenerationCode1
AttentionInfluence: Adopting Attention Head Influence for Weak-to-Strong Pretraining Data Selection—0
Enhancing Code Generation via Bidirectional Comment-Level Mutual GroundingCode0
Web-Bench: A LLM Code Benchmark Based on Web Standards and FrameworksCode3
CodeMixBench: Evaluating Large Language Models on Code Generation with Code-Mixed Prompts—0
Memorization or Interpolation ? Detecting LLM Memorization through Input Perturbation Analysis—0
Rewriting Pre-Training Data Boosts LLM Performance in Math and CodeCode1
The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Models—0
ARCS: Agentic Retrieval-Augmented Code Synthesis with Iterative Refinement—0
DataDecide: How to Predict Best Pretraining Data with Small ExperimentsCode3
Type-Constrained Code Generation with Language Models—0
OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs—0
Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency—0
Can LLMs Enable Verification in Mainstream Programming?—0
Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models—0
RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox TestingCode1
Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Enhancement Protocol—0
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs?—0
ThrowBench: Benchmarking LLMs by Predicting Runtime ExceptionsCode0
KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for CodingCode3
Layer-Aware Task Arithmetic: Disentangling Task-Specific and Instruction-Following Knowledge—0
Isolating Language-Coding from Problem-Solving: Benchmarking LLMs with PseudoEval—0
Nexus: A Lightweight and Scalable Multi-Agent Framework for Complex Tasks AutomationCode2
CodeCriticBench: A Holistic Code Critique Benchmark for Large Language ModelsCode1
Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation CapabilitiesCode1
UnitCoder: Scalable Iterative Code Synthesis with Unit Test Guidance—0
MasRouter: Learning to Route LLMs for Multi-Agent SystemsCode2
CopySpec: Accelerating LLMs with Speculative Copy-and-Paste Without Compromising QualityCode0
Show:102550
← PrevPage 1 of 6Next →

No leaderboard results yet.