AMR Parsing
Each AMR is a single rooted, directed graph. AMRs include PropBank semantic roles, within-sentence coreference, named entities and types, modality, negation, questions, quantities, and so on. See.
Papers
Showing 1–25 of 117 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | StructBART + MBSE (IBM) | Smatch | 86.7 | — | Unverified |
| 2 | Graphene Smatch (IBM) | Smatch | 86.26 | — | Unverified |
| 3 | LeakDistill | Smatch | 86.1 | — | Unverified |
| 4 | StructBART + MBSE (IBM) | Smatch | 85.9 | — | Unverified |
| 5 | Graphene Support (IBM) | Smatch | 85.85 | — | Unverified |
| 6 | AMRBART large | Smatch | 85.4 | — | Unverified |
| 7 | ATP-SRL (Ensemble) | Smatch | 85.3 | — | Unverified |
| 8 | ATP-SRL | Smatch | 85.2 | — | Unverified |
| 9 | StructBART-J (IBM) | Smatch | 84.7 | — | Unverified |
| 10 | BiBL+Silver | Smatch | 84.7 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | APT (IBM) | F1 Full | 78.5 | — | Unverified |
| 2 | stack-Transformer + self-learning (IBM) | F1 Full | 78.2 | — | Unverified |
| 3 | AMR Parsing via Graph-Sequence Iterative Inference | F1 Full | 75.4 | — | Unverified |
| 4 | Broad-Coverage Semantic Parsing as Transduction | F1 Full | 71.3 | — | Unverified |
| 5 | Two-stage Sequence-to-Graph Transducer | F1 Full | 70.2 | — | Unverified |
| 6 | Imitation learning | F1 Newswire | 70 | — | Unverified |
| 7 | Transition-based+improved aligner+ensemble | F1 Full | 68.4 | — | Unverified |
| 8 | Improved CAMR | F1 Full | 68.1 | — | Unverified |
| 9 | Transition-based transducer | F1 Full | 66 | — | Unverified |
| 10 | Incremental joint model | F1 Full | 66 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Graphene Smatch (MBSE paper) (IBM) | Smatch | 85.4 | — | Unverified |
| 2 | Graphene Smatch (IBM) | Smatch | 84.87 | — | Unverified |
| 3 | LeakDistill | Smatch | 84.6 | — | Unverified |
| 4 | Graphene Support (IBM) | Smatch | 84.41 | — | Unverified |
| 5 | StructBART + MBSE (IBM) | Smatch | 84.3 | — | Unverified |
| 6 | AMRBART large | Smatch | 84.2 | — | Unverified |
| 7 | ATP-SRL | Smatch | 84 | — | Unverified |
| 8 | BiBL | Smatch | 83.9 | — | Unverified |
| 9 | BiBL+Silver | Smatch | 83.5 | — | Unverified |
| 10 | LeakDistill (base) | Smatch | 83.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Joint model | Smatch | 73.7 | — | Unverified |
| 2 | Mul-BiLSTM | Smatch | 70.7 | — | Unverified |
| 3 | JAMR | Smatch | 67 | — | Unverified |
| 4 | CAMR | Smatch | 66.5 | — | Unverified |
| 5 | AMREager | Smatch | 64 | — | Unverified |
| 6 | SEQ2SEQ + 20M | Smatch | 62.1 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | StructBART + MBSE (IBM) | Smatch | 66.9 | — | Unverified |
| 2 | AMRBART large | Smatch | 63.2 | — | Unverified |
| 3 | Graphene Smatch | Smatch | 62.8 | — | Unverified |
| 4 | SPRING DFS | Smatch | 59.7 | — | Unverified |
| 5 | SPRING DFS + silver | Smatch | 59.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | AMRBART large | Smatch | 76.9 | — | Unverified |
| 2 | Graphene Smatch | Smatch | 76.32 | — | Unverified |
| 3 | SPRING DFS | Smatch | 73.7 | — | Unverified |
| 4 | SPRING DFS + silver | Smatch | 71.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | AMRBART large | Smatch | 79.8 | — | Unverified |
| 2 | Graphene Smatch | Smatch | 79.52 | — | Unverified |
| 3 | SPRING DFS + silver | Smatch | 77.5 | — | Unverified |
| 4 | SPRING DFS | Smatch | 77.3 | — | Unverified |