SOTAVerified

Medical Code Prediction

Context: Prediction of medical codes from clinical notes is both a practical and essential need for every healthcare delivery organization within current medical systems. Automating annotation will save significant time and excessive effort by human coders today. A new milestone will mark a meaningful step toward fully Autonomous Medical Coding in machines reaching parity with human coders' performance in medical code prediction.

Question: What exactly is the medical code prediction problem?

Answer: Clinical notes contain much information about what precisely happened during the patient's entire stay. And those clinical notes (e.g., discharge summary) is typically long, loosely structured, consists of medical domain language, and sometimes riddled with spelling errors. So, it's a highly multi-label classification problem, and the forthcoming ICD-11 standard will add more complexity to the problem! The medical code prediction problem is to annotate this clinical note with multiple codes subset from nearly 70K total codes (in the current ICD-10 system, for example).

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GKI-ICDMicro-F161.2—Unverified
2PLM-CAMicro-F160—Unverified
3MSMN+KEPTLongformerMicro-F159.9—Unverified
4EffectiveCANMicro-F158.9—Unverified
5Discnet+REMicro-F158.8—Unverified
6RACMicro-F158.6—Unverified
7MSMNMicro-F158.4—Unverified
8LAATMicro-F157.5—Unverified
9JointLAATMicro-F157.5—Unverified
10MSATT-KGMicro-F155.3—Unverified
#ModelMetricClaimedVerifiedStatus
1PLM-ICDPrecision@869.9—Unverified
2LAATPrecision@868.9—Unverified
3MultiResCNNPrecision@867.8—Unverified
4CAMLPrecision@866.8—Unverified
5Bi-GRUPrecision@862.6—Unverified
6CNNPrecision@860.3—Unverified
#ModelMetricClaimedVerifiedStatus
1PLM-ICDAUC Macro97.2—Unverified
2LAATAUC Macro96—Unverified
3MultiResCNNAUC Macro95.1—Unverified
4Bi-GRUAUC Macro93.8—Unverified
5CAMLAUC Macro90.7—Unverified
6CNNAUC Macro89.4—Unverified
#ModelMetricClaimedVerifiedStatus
1MSMNMacro-AUC97.07—Unverified
2Joint LAATMacro-AUC93.64—Unverified
3LAATMacro-AUC92.96—Unverified
4PLMMacro-AUC91.85—Unverified
5CAMLMacro-AUC89.91—Unverified
#ModelMetricClaimedVerifiedStatus
1MSMNF1 (micro)74.15—Unverified
2PLM-ICDF1 (micro)73.27—Unverified
3Joint LAATF1 (micro)72.85—Unverified
4LAATF1 (micro)72.56—Unverified
5CAMLF1 (micro)67.56—Unverified
#ModelMetricClaimedVerifiedStatus
1MSMNMacro AUC96.79—Unverified
2PLM-ICDMacro AUC96.61—Unverified
3Joint LAATMacro AUC95.57—Unverified
4LAATMacro AUC95.18—Unverified
5CAMLMacro AUC93.45—Unverified
#ModelMetricClaimedVerifiedStatus
1MSMNAUC Macro95.13—Unverified
2PLM-ICDAUC Macro94.97—Unverified
3Joint LAATAUC Macro94.92—Unverified
4LAATAUC Macro94.88—Unverified
5CAMLAUC Macro93.07—Unverified