SOTAVerified

Action Segmentation

Action Segmentation is a challenging problem in high-level video understanding. In its simplest form, Action Segmentation aims to segment a temporally untrimmed video by time and label each segmented part with one of pre-defined action labels. The results of Action Segmentation can be further used as input to various applications, such as video-to-text and action localization.

Source: TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 219 papers

TitleStatusHype
Multi-granularity Correspondence Learning from Long-term Noisy VideosCode2
Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality AssessmentCode2
Temporal Action Segmentation: An Analysis of Modern TechniquesCode2
Is Weakly-supervised Action Segmentation Ready For Human-Robot Interaction? No, Let's Improve It With Action-union LearningCode2
FACT: Frame-Action Cross-Attention Temporal Modeling for Efficient Action SegmentationCode2
Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action SegmentationCode2
Temporal Alignment Networks for Long-term VideoCode1
Set-Supervised Action Learning in Procedural Task Videos via Pairwise Order ConsistencyCode1
Temporal Convolutional Networks for Action Segmentation and DetectionCode1
Refining Action Segmentation With Hierarchical Video RepresentationsCode1
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object InteractionCode1
Streaming Video Temporal Action Segmentation In Real TimeCode1
Temporal Action Segmentation from Timestamp SupervisionCode1
Learning to Segment Actions from Observation and NarrationCode1
EPFL-Smart-Kitchen-30: Densely annotated cooking dataset with 3D kinematics to challenge video and language modelsCode1
RF-Next: Efficient Receptive Field Search for Convolutional Neural NetworksCode1
Actor and Action Video Segmentation from a SentenceCode1
Efficient Two-Step Networks for Temporal Action SegmentationCode1
End-to-End Learning of Visual Representations from Uncurated Instructional VideosCode1
End-to-End Streaming Video Temporal Action Segmentation with Reinforce LearningCode1
Action Segmentation with Joint Self-Supervised Temporal Domain AdaptationCode1
Progress-Aware Online Action Segmentation for Egocentric Procedural Task VideosCode1
How Much Temporal Long-Term Context is Needed for Action Segmentation?Code1
LOGO: A Long-Form Video Dataset for Group Action Quality AssessmentCode1
Alleviating Over-segmentation Errors by Detecting Action BoundariesCode1
Skeleton-Based Action Segmentation with Multi-Stage Spatial-Temporal Graph Convolutional Neural NetworksCode1
Iterative Contrast-Classify For Semi-supervised Temporal Action SegmentationCode1
Leveraging triplet loss for unsupervised action segmentationCode1
Language-Assisted Skeleton Action Understanding for Skeleton-Based Temporal Action SegmentationCode1
Learning Discriminative Prototypes with Dynamic Time WarpingCode1
Permutation-Aware Action Segmentation via Unsupervised Frame-to-Segment AlignmentCode1
3D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation ApproachCode1
ASQuery: A Query-based Model for Action SegmentationCode1
Long-Tail Temporal Action Segmentation with Group-wise Temporal Logit AdjustmentCode1
Diffusion Action SegmentationCode1
Automated freezing of gait assessment with marker-based motion capture and multi-stage spatial-temporal graph convolutional neural networksCode1
Activity Grammars for Temporal Action SegmentationCode1
MS-TCN++: Multi-Stage Temporal Convolutional Network for Action SegmentationCode1
ASFormer: Transformer for Action SegmentationCode1
Boundary-Aware Cascade Networks for Temporal Action SegmentationCode1
Bridge-Prompt: Towards Ordinal Action Understanding in Instructional VideosCode1
A Decoupled Spatio-Temporal Framework for Skeleton-based Action SegmentationCode1
Hierarchical Vector Quantization for Unsupervised Action SegmentationCode1
Coarse to Fine Multi-Resolution Temporal Convolutional NetworkCode1
Few-Shot Temporal Action Localization with Query Adaptive TransformerCode1
Global2Local: Efficient Structure Search for Video Action SegmentationCode1
Mamba4D: Efficient 4D Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space ModelsCode1
Pretrained Language Models as Visual Planners for Human AssistanceCode1
Alleviating Class-wise Gradient Imbalance for Pulmonary Airway SegmentationCode1
SCT: Set Constrained Temporal Transformer for Set Supervised Action SegmentationCode1
Show:102550
← PrevPage 1 of 5Next →
All datasetsBreakfast50 SaladsGTEACOINAssembly101JIGSAWSYoutube INRIA Instructional50SaladsMPII Cooking 2 Dataset

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AdaFocus (newly extracted I3D-features, LT-Context model)Average F176.2—Unverified
2FACT (efficient hybrid of convolution and transformer model)Average F174.7—Unverified
3ASQueryAverage F174.6—Unverified
4BITAverage F173.7—Unverified
5DiffActAverage F173.6—Unverified
6BaFormerAverage F172.4—Unverified
7CETNetAverage F171.8—Unverified
8SF-TMN(ASFormer)Average F171.6—Unverified
9RF++-SSTDAAcc70.8—Unverified
10ASPnetAverage F170.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Br-Prompt+ASPnet (RGB, flow, accelerometer)F1@50%88.5—Unverified
2Semantic2GraphF1@50%87.3—Unverified
3BaFormerF1@50%83.9—Unverified
4DiffActF1@50%83.7—Unverified
5SF-TMN(ASFormer)F1@50%82.9—Unverified
6LTContextF1@50%82—Unverified
7UVASTF1@50%81.7—Unverified
8Br-Prompt+ASFormerF1@50%81.3—Unverified
9EUTF1@50%81—Unverified
10CETNetF1@50%80.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Semantic2GraphF1@50%91.3—Unverified
2FACTF1@50%87.5—Unverified
3DiffActF1@50%84.7—Unverified
4BaFormerF1@50%83.5—Unverified
5SF-TMN(ASFormer)F1@50%83.1—Unverified
6Br-Prompt+ASFormerF1@50%83—Unverified
7DPRNF1@50%82.9—Unverified
8BITF1@50%82.6—Unverified
9CETNetF1@50%81.3—Unverified
10UVASTF1@50%81—Unverified
#ModelMetricClaimedVerifiedStatus
1UnLoc-LFrame accuracy72.8—Unverified
2UnivlFrame accuracy70—Unverified
3NortonFrame accuracy69.8—Unverified
4VideoClipFrame accuracy68.7—Unverified
5TACoFrame accuracy68.4—Unverified
6VLMFrame accuracy68.4—Unverified
7MIL-NCEFrame accuracy61—Unverified
8ActBERTFrame accuracy57—Unverified
9CBTFrame accuracy53.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ASQueryF1@10%37.8—Unverified
2LTContextF1@10%33.9—Unverified
3ASFormerF1@10%33.4—Unverified
4C2F-TCNF1@10%33.3—Unverified
5UVASTF1@10%32.1—Unverified
6MS-TCN++F1@10%31.6—Unverified
7ProTAS(Offline)F1@10%28.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RL+TreeEdit Distance88.53—Unverified
2RL (full)Edit Distance87.96—Unverified
3TricorNetEdit Distance86.8—Unverified
4SDL+SC-CRFEdit Distance86.21—Unverified
5TCNEdit Distance83.1—Unverified
6ST-CNN+SegEdit Distance66.56—Unverified
#ModelMetricClaimedVerifiedStatus
1TSA (FINCH)Acc62.4—Unverified
2TSA (Kmeans)Acc59.7—Unverified
#ModelMetricClaimedVerifiedStatus
1EUTAcc87.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Unsup. TW-FINCH (K=avg/activity)Accuracy42—Unverified