SOTAVerified

Explanation Generation

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1VLIS (Lynx)Accuracy80—Unverified
2VLIS (LLaVA)Accuracy73—Unverified
3Ground-truth Caption -> GPT3 (Oracle)Human (%)68—Unverified
4Predicted Caption -> GPT3Human (%)33—Unverified
5BLIP2 FlanT5-XXL (Fine-tuned)Human (%)27—Unverified
6BLIP2 FlanT5-XL (Fine-tuned)Human (%)15—Unverified
7BLIP2 FlanT5-XXL (Zero-shot)Human (%)0—Unverified
#ModelMetricClaimedVerifiedStatus
1PJ-XB487.4—Unverified
2FMB478.8—Unverified
#ModelMetricClaimedVerifiedStatus
1OFA-XHuman Explanation Rating85.7—Unverified
2OFA-X-MTHuman Explanation Rating80.4—Unverified
#ModelMetricClaimedVerifiedStatus
1OFA-X-MTHuman Explanation Rating77.3—Unverified
2OFA-XHuman Explanation Rating68.9—Unverified
#ModelMetricClaimedVerifiedStatus
1OFA-XHuman Explanation Rating89.5—Unverified
2OFA-X-MTHuman Explanation Rating87.8—Unverified