Video Quality Assessment
Video Quality Assessment is a computer vision task aiming to mimic video-based human subjective perception. The goal is to produce a mos score, where higher score indicates better perceptual quality. Some well-known benchmarks for this task are KoNViD-1k, LIVE-VQC, YouTube-UGC and LSVQ. SROCC/PLCC/RMSE are usually used to evaluate the performance of different models.
Papers
Showing 1–25 of 216 papers
All datasetsMSU SR-QA DatasetKoNViD-1kMSU NR VQA DatabaseLIVE-VQCMSU FR VQA DatabaseYouTube-UGCLIVE-FB LSVQLIVE-ETRILIVE LivestreamLIVE-YT-HFR
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | PieAPP | SROCC | 0.75 | — | Unverified |
| 2 | Q-Align (IQA) | SROCC | 0.75 | — | Unverified |
| 3 | Q-Align (VQA) | SROCC | 0.72 | — | Unverified |
| 4 | PaQ-2-PiQ | SROCC | 0.71 | — | Unverified |
| 5 | DBCNN | SROCC | 0.69 | — | Unverified |
| 6 | MUSIQ trained on PaQ-2-PiQ | SROCC | 0.68 | — | Unverified |
| 7 | Ma-Metric | SROCC | 0.67 | — | Unverified |
| 8 | MANIQA | SROCC | 0.67 | — | Unverified |
| 9 | ClipIQA+ ResNet50 | SROCC | 0.66 | — | Unverified |
| 10 | MUSIQ trained on SPAQ | SROCC | 0.65 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DOVER (end-to-end) | PLCC | 0.91 | — | Unverified |
| 2 | FasterVQA (fine-tuned) | PLCC | 0.9 | — | Unverified |
| 3 | DOVER (head-only) | PLCC | 0.89 | — | Unverified |
| 4 | FAST-VQA (finetuned on KonViD-1k) | PLCC | 0.89 | — | Unverified |
| 5 | ReLaX-VQA (finetuned on KoNViD-1k) | PLCC | 0.87 | — | Unverified |
| 6 | SimpleVQA | PLCC | 0.86 | — | Unverified |
| 7 | DisCoVQA | PLCC | 0.86 | — | Unverified |
| 8 | HVS-5M | PLCC | 0.86 | — | Unverified |
| 9 | FAST-VQA (trained on LSVQ only) | PLCC | 0.86 | — | Unverified |
| 10 | CONVIQT | PLCC | 0.85 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ReLaX-VQA (finetuned on LIVE-VQC) | PLCC | 0.89 | — | Unverified |
| 2 | DOVER (end-to-end) | PLCC | 0.87 | — | Unverified |
| 3 | DOVER (head-only) | PLCC | 0.86 | — | Unverified |
| 4 | FAST-VQA (finetuned on LIVE-VQC) | PLCC | 0.86 | — | Unverified |
| 5 | FasterVQA (fine-tuned) | PLCC | 0.86 | — | Unverified |
| 6 | FAST-VQA (trained on LSVQ only) | PLCC | 0.84 | — | Unverified |
| 7 | DisCoVQA | PLCC | 0.84 | — | Unverified |
| 8 | HVS-5M | PLCC | 0.84 | — | Unverified |
| 9 | BVQA-2022 | PLCC | 0.84 | — | Unverified |
| 10 | 2BiVQA | PLCC | 0.83 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | VMAF Y (v063) | SRCC | 0.94 | — | Unverified |
| 2 | VMAF Y (v061) | SRCC | 0.94 | — | Unverified |
| 3 | VMAF Y (v062) | SRCC | 0.94 | — | Unverified |
| 4 | AHIQ | SRCC | 0.94 | — | Unverified |
| 5 | VMAF Y (v061_neg) | SRCC | 0.91 | — | Unverified |
| 6 | VIFp | SRCC | 0.91 | — | Unverified |
| 7 | VSI | SRCC | 0.91 | — | Unverified |
| 8 | MS-SSIM | SRCC | 0.9 | — | Unverified |
| 9 | SR-SIM | SRCC | 0.9 | — | Unverified |
| 10 | FSIM | SRCC | 0.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DOVER (end-to-end) | PLCC | 0.87 | — | Unverified |
| 2 | ReLaX-VQA (finetuned on YouTube-UGC) | PLCC | 0.87 | — | Unverified |
| 3 | DOVER (head-only) | PLCC | 0.86 | — | Unverified |
| 4 | FasterVQA (fine-tuned) | PLCC | 0.86 | — | Unverified |
| 5 | SimpleVQA | PLCC | 0.86 | — | Unverified |
| 6 | FAST-VQA (finetuned on YouTube-UGC) | PLCC | 0.85 | — | Unverified |
| 7 | HVS-5M | PLCC | 0.85 | — | Unverified |
| 8 | ReLaX-VQA (trained on LSVQ only) | PLCC | 0.84 | — | Unverified |
| 9 | CONVIQT | PLCC | 0.82 | — | Unverified |
| 10 | ReLaX-VQA | PLCC | 0.82 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | OneAlign + FAST-VQA | PLCC | 0.9 | — | Unverified |
| 2 | DOVER | PLCC | 0.89 | — | Unverified |
| 3 | OneAlign | PLCC | 0.89 | — | Unverified |
| 4 | FAST-VQA | PLCC | 0.88 | — | Unverified |
| 5 | FasterVQA | PLCC | 0.87 | — | Unverified |
| 6 | HVS-5M | PLCC | 0.87 | — | Unverified |
| 7 | SimpleVQA | PLCC | 0.86 | — | Unverified |
| 8 | BVQA-2022 | PLCC | 0.85 | — | Unverified |
| 9 | DisCoVQA | PLCC | 0.85 | — | Unverified |
| 10 | PVQ | PLCC | 0.83 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ST-GREED | SRCC | 0.88 | — | Unverified |
| 2 | GREED-VMAF | SRCC | 0.87 | — | Unverified |
| 3 | GSTI | SRCC | 0.81 | — | Unverified |