SOTAVerified

EditCompletion

Given a code snippet that is partially edited, the goal is to predict a completion of the edit for the rest of the snippet.

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1C3POAccuracy53.2Unverified
2LaserTagger (Transformer)Accuracy41.4Unverified
3LaserTagger (LSTM)Accuracy40.9Unverified
4SequenceR (Transformer)Accuracy32.6Unverified
5SequenceRAccuracy30.7Unverified
6Path2Tree (Transformer)Accuracy25.5Unverified
7Path2Tree (LSTM)Accuracy22.5Unverified