SOTAVerified

Image Matting

Image Matting is the process of accurately estimating the foreground object in images and videos. It is a very important technique in image and video editing applications, particularly in film production for creating visual effects. In case of image segmentation, we segment the image into foreground and background by labeling the pixels. Image segmentation generates a binary image, in which a pixel either belongs to foreground or background. However, Image Matting is different from the image segmentation, wherein some pixels may belong to foreground as well as background, such pixels are called partial or mixed pixels. In order to fully separate the foreground from the background in an image, accurate estimation of the alpha values for partial or mixed pixels is necessary.

Source: Automatic Trimap Generation for Image Matting

Image Source: Real-Time High-Resolution Background Matting

Papers

Showing 150 of 225 papers

TitleStatusHype
Post-Training Quantization for Video Matting0
MP-Mat: A 3D-and-Instance-Aware Human Matting and Editing Framework with Multiplane RepresentationCode0
MaSS13K: A Matting-level Semantic Segmentation BenchmarkCode2
VRMDiff: Text-Guided Video Referring Matting Generation of DiffusionCode1
Path-Adaptive Matting for Efficient Inference Under Various Computational Cost Constraints0
Object-Aware Video Matting with Cross-Frame Guidance0
Enhancing Image Matting in Real-World Scenes with Mask-Guided Iterative Refinement0
Efficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors0
MatAnyone: Stable Video Matting with Consistent Memory Propagation0
BEN: Using Confidence-Guided Matting for Dichotomous Image SegmentationCode0
Polarized Color Screen Matting0
ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation LearningCode0
ILDiff: Generate Transparent Animated Stickers by Implicit Layout Distillation0
Memory Efficient Matting with Adaptive Token RoutingCode2
Morpho-Aware Global Attention for Image Matting0
ZIM: Zero-Shot Image Matting for AnythingCode3
Automating Video Thumbnails Selection and Generation with Multimodal and Multistage Analysis0
DFIMat: Decoupled Flexible Interactive Matting in Multi-Person ScenariosCode0
Towards Natural Image Matting in the Wild via Real-Scenario PriorCode2
Alfie: Democratising RGBA Image Generation With No $Code2
Training Matting Models without Alpha LabelsCode1
Matting by Generation0
FADE: A Task-Agnostic Upsampling Operator for Encoder-Decoder ArchitecturesCode1
Boosting General Trimap-free Matting in the Real-World Image0
MaGGIe: Masked Guided Gradual Human Instance MattingCode2
Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human MattingCode0
Learning Trimaps via Clicks for Image MattingCode1
Learning Multiple Representations with Inconsistency-Guided Detail Regularization for Mask-Guided Matting0
In-Context MattingCode2
What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?Code3
DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation0
End-to-End Human Instance MattingCode1
Dual-Context Aggregation for Universal Image MattingCode0
DART: Depth-Enhanced Accurate and Real-Time Background Matting0
POBEVM: Real-time Video Matting via Progressively Optimize the Target Body and Edge0
PolarMatte: Fully Computational Ground-Truth-Quality Alpha Matte Extraction for Images and Video using Polarized Screen Matting0
MAGICK: A Large-scale Captioned Dataset from Matting Generated Images using Chroma Keying0
Unifying Automatic and Interactive Matting with Pretrained ViTsCode1
Lightweight high-resolution Subject Matting in the Real World0
Diffusion for Natural Image MattingCode1
DiffusionMat: Alpha Matting as Sequential Refinement Learning0
Video Instance MattingCode1
Lightweight Portrait Matting via Regional Attention and Refinement0
OmnimatteRF: Robust Omnimatte with 3D Background ModelingCode1
EFormer: Enhanced Transformer towards Semantic-Contour Features of Foreground for Portraits Matting0
On Point Affiliation in Feature UpsamplingCode1
Training-Free Neural Matte Extraction for Visual Effects0
Matting AnythingCode2
Matte Anything: Interactive Natural Image Matting with Segment Anything ModelsCode2
Color-aware Deep Temporal Backdrop Duplex Matting System0
Show:102550
← PrevPage 1 of 5Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DIMMSE14Unverified
2IndexNet-MattingMSE13Unverified
3Context-Aware MattingMSE8.2Unverified
4SIMMSE5.8Unverified
5LSAMattingMSE5.4Unverified
6FBAMattingMSE5.3Unverified
7PP-MattingMSE5Unverified
8LFPNetMSE4.1Unverified
9MatteFormerMSE4Unverified
10TMFNetMSE3.6Unverified
#ModelMetricClaimedVerifiedStatus
1SHMCSAD61.5Unverified
2LFSAD36.12Unverified
3HATTSAD28.01Unverified
4SHMSAD17.81Unverified
5GFM(r)SAD10.89Unverified
6GFM(d)SAD10.26Unverified
7GFM(r2b)SAD10.24Unverified
8GFM(r')SAD9.66Unverified
9StyleMatteSAD9.6Unverified
#ModelMetricClaimedVerifiedStatus
1LFSAD42.95Unverified
2HATTSAD25.99Unverified
3SHMSAD21.56Unverified
4GFMSAD13.2Unverified
5P3M-Net (r)SAD8.73Unverified
6StyleMatteSAD6.97Unverified
7P3M-Net (v)SAD6.24Unverified
#ModelMetricClaimedVerifiedStatus
1LFSAD191.74Unverified
2SHMSAD170.44Unverified
3U2NETSAD83.46Unverified
4GFMSAD52.66Unverified
5AIM-NetSAD43.92Unverified
6DiffMatteSAD16.31Unverified
#ModelMetricClaimedVerifiedStatus
1CAMMSE4.5Unverified
2BMMSE1.33Unverified
3IMMSE1.16Unverified
4Adobe LS-GANMSE0.97Unverified
#ModelMetricClaimedVerifiedStatus
1PP-MattingSAD40.69Unverified
2DCAMSAD31.27Unverified
3ViTMatteSAD17.05Unverified
4DiffMatteSAD15.5Unverified
#ModelMetricClaimedVerifiedStatus
1MODNet+MAD0.81Unverified
#ModelMetricClaimedVerifiedStatus
1MODNet+ (Our)MAD0.97Unverified