SOTAVerified

HumanEval

Papers

Showing 151200 of 264 papers

TitleStatusHype
Evaluating Large Language Models for Code Review0
Reasoning Runtime Behavior of a Program with LLM: How Far Are We?0
Exploring and Evaluating Hallucinations in LLM-Powered Code Generation0
Falcon: Faster and Parallel Inference of Large Language Models through Enhanced Semi-Autoregressive Drafting and Custom-Designed Decoding Tree0
From Output to Evaluation: Does Raw Instruction-Tuned Code LLMs Output Suffice for Fill-in-the-Middle Code Generation?0
Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models0
G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks0
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs?0
GRIN: GRadient-INformed MoE0
Guaranteed Guess: A Language Modeling Approach for CISC-to-RISC Transpilation with Testing Guarantees0
Guided Code Generation with LLMs: A Multi-Agent Framework for Complex Code Tasks0
Guideline Forest: Experience-Induced Multi-Guideline Reasoning with Stepwise Aggregation0
Importing Phantoms: Measuring LLM Package Hallucination Vulnerabilities0
Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Models0
InfiFusion: A Unified Framework for Enhanced Cross-Model Reasoning via LLM Fusion0
Interactive Code Generation via Test-Driven User-Intent Formalization0
Isolating Language-Coding from Problem-Solving: Benchmarking LLMs with PseudoEval0
Kotlin ML Pack: Technical Report0
Large Language Model Guided Self-Debugging Code Generation0
Layer-Aware Task Arithmetic: Disentangling Task-Specific and Instruction-Following Knowledge0
Learning How To Ask: Cycle-Consistency Refines Prompts in Multimodal Foundation Models0
Learning to Reason via Self-Iterative Process Feedback for Small Language Models0
Leveraging Metamemory Mechanisms for Enhanced Data-Free Code Generation in LLMs0
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code0
LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models0
LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing0
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression0
Low-Cost Language Models: Survey and Performance Evaluation on Python Code Generation0
MaPPing Your Model: Assessing the Impact of Adversarial Attacks on LLM-based Programming Assistants0
USCD: Improving Code Generation of LLMs by Uncertainty-Aware Selective Contrastive Decoding0
Memorization or Interpolation ? Detecting LLM Memorization through Input Perturbation Analysis0
MojoBench: Language Modeling and Benchmarks for Mojo0
Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs0
NExT: Teaching Large Language Models to Reason about Code Execution0
NoFunEval: Funny How Code LMs Falter on Requirements Beyond Functional Correctness0
On the Limitations of Embedding Based Methods for Measuring Functional Correctness for Code Generation0
OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs0
PanGu-Coder2: Boosting Large Language Models for Code with Ranking Feedback0
Past as a Guide: Leveraging Retrospective Learning for Python Code Completion0
PERC: Plan-As-Query Example Retrieval for Underrepresented Code Generation0
Piloting Copilot, Codex, and StarCoder2: Hot Temperature, Cold Prompts, or Black Magic?0
Plan for Speed -- Dilated Scheduling for Masked Diffusion Language Models0
PLUM: Improving Code LMs with Execution-Guided On-Policy Preference Learning Driven By Synthetic Test Cases0
Prior Prompt Engineering for Reinforcement Fine-Tuning0
Qiskit Code Assistant: Training LLMs for generating Quantum Computing Code0
Qiskit HumanEval: An Evaluation Benchmark For Quantum Code Generative Models0
QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks0
Reactor Mk.1 performances: MMLU, HumanEval and BBH test results0
Reasoning-as-Logic-Units: Scaling Test-Time Reasoning in Large Language Models Through Logic Unit Alignment0
Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models0
Show:102550
← PrevPage 4 of 6Next →

No leaderboard results yet.