MMR total
Sum of all scores of the 11 distinct tasks involving texts, fonts, visual elements, bounding boxes, spatial relations, and grounding in the Multi-Modal Reading (MMR) Benchmark.
Papers
No papers found.
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Claude 3.5 Sonnet | Total Column Score | 463 | — | Unverified |
| 2 | GPT-4o | Total Column Score | 457 | — | Unverified |
| 3 | GPT-4V | Total Column Score | 415 | — | Unverified |
| 4 | LLaVA-NEXT-34B | Total Column Score | 412 | — | Unverified |
| 5 | Phi-3-Vision | Total Column Score | 397 | — | Unverified |
| 6 | InternVL2-8B | Total Column Score | 368 | — | Unverified |
| 7 | Qwen-vl-max | Total Column Score | 366 | — | Unverified |
| 8 | LLaVA-NEXT-13B | Total Column Score | 335 | — | Unverified |
| 9 | Qwen-vl-plus | Total Column Score | 310 | — | Unverified |
| 10 | Idefics-2-8B | Total Column Score | 256 | — | Unverified |