SOTAVerified

Action Segmentation

Action Segmentation is a challenging problem in high-level video understanding. In its simplest form, Action Segmentation aims to segment a temporally untrimmed video by time and label each segmented part with one of pre-defined action labels. The results of Action Segmentation can be further used as input to various applications, such as video-to-text and action localization.

Source: TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 219 papers

TitleStatusHype
LAC - Latent Action Composition for Skeleton-based Action Segmentation—0
2by2: Weakly-Supervised Learning for Global Action Segmentation—0
Continuous Human Action Recognition for Human-Machine Interaction: A Review—0
Learning a Weakly-Supervised Video Actor-Action Segmentation Model with a Wise Selection—0
Condensing Action Segmentation Datasets via Generative Network Inversion—0
Coherent Temporal Synthesis for Incremental Action Segmentation—0
Leveraging Action Affinity and Continuity for Semi-supervised Temporal Action Segmentation—0
Leveraging Hierarchical Parametric Networks for Skeletal Joints Based Action Segmentation and Recognition—0
CASR: Refining Action Segmentation via Marginalizing Frame-levle Causal Relationships—0
C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentation—0
Long Short View Feature Decomposition via Contrastive Video Representation Learning—0
BIT: Bi-Level Temporal Modeling for Efficient Supervised Action Segmentation—0
Weakly-Supervised Online Action Segmentation in Multi-View Instructional Videos—0
M2R2: MulitModal Robotic Representation for Temporal Action Segmentation—0
A Wireless-Vision Dataset for Privacy Preserving Human Activity Recognition—0
MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models—0
Markov Game Video Augmentation for Action Segmentation—0
Maximization and restoration: Action segmentation through dilation passing and temporal reconstruction—0
MED-VT++: Unifying Multimodal Learning with a Multiscale Encoder-Decoder Video Transformer—0
Motion2Vec: Semi-Supervised Representation Learning from Surgical Videos—0
Unsupervised Action Segmentation for Instructional Videos—0
Automatic Gesture Recognition in Robot-assisted Surgery with Reinforcement Learning and Tree Search—0
ASPnet: Action Segmentation With Shared-Private Representation of Multiple Data Sources—0
Representation Learning on Visual-Symbolic Graphs for Video Understanding—0
NeuralNetwork-Viterbi: A Framework for Weakly Supervised Video Learning—0
NSM4D: Neural Scene Model Based Online 4D Point Cloud Sequence Understanding—0
On Evaluating Weakly Supervised Action Segmentation Methods—0
SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentation—0
Faster Diffusion Action Segmentation—0
O-TALC: Steps Towards Combating Oversegmentation within Online Action Segmentation—0
Unsupervised Discriminative Embedding for Sub-Action Learning in Complex Activities—0
An End-to-end 3D Convolutional Neural Network for Action Detection and Segmentation in Videos—0
Weakly Supervised Actor-Action Segmentation via Robust Multi-Task Ranking—0
An Efficient Framework for Few-shot Skeleton-based Temporal Action Segmentation—0
An Efficient 3D CNN for Action/Object Segmentation in Video—0
Prompt-enhanced Hierarchical Transformer Elevating Cardiopulmonary Resuscitation Instruction via Temporal Action Segmentation—0
Video Action Segmentation via Contextually Refined Temporal Keypoints—0
Reducing the Label Bias for Timestamp Supervised Temporal Action Segmentation—0
Anchor-Constrained Viterbi for Set-Supervised Action Segmentation—0
Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery—0
A Hybrid RNN-HMM Approach for Weakly Supervised Temporal Action Segmentation—0
Robotic Imitation of Human Actions—0
Robust Action Segmentation from Timestamp Supervision—0
A Generalized & Robust Framework For Timestamp Supervision in Temporal Action Segmentation—0
Segmental Spatiotemporal CNNs for Fine-grained Action Segmentation—0
Self-supervised pretraining of vision transformers for animal behavioral analysis and neural encoding—0
Semantic2Graph: Graph-based Multi-modal Feature Fusion for Action Segmentation in Videos—0
Video Action Segmentation with Hybrid Temporal Networks—0
Set-Constrained Viterbi for Set-Supervised Action Segmentation—0
ADL4D: Towards A Contextually Rich Dataset for 4D Activities of Daily Living—0
Show:102550
← PrevPage 3 of 5Next →
All datasetsBreakfast50 SaladsGTEACOINAssembly101JIGSAWSYoutube INRIA Instructional50SaladsMPII Cooking 2 Dataset

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AdaFocus (newly extracted I3D-features, LT-Context model)Average F176.2—Unverified
2FACT (efficient hybrid of convolution and transformer model)Average F174.7—Unverified
3ASQueryAverage F174.6—Unverified
4BITAverage F173.7—Unverified
5DiffActAverage F173.6—Unverified
6BaFormerAverage F172.4—Unverified
7CETNetAverage F171.8—Unverified
8SF-TMN(ASFormer)Average F171.6—Unverified
9RF++-SSTDAAcc70.8—Unverified
10ASPnetAverage F170.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Br-Prompt+ASPnet (RGB, flow, accelerometer)F1@50%88.5—Unverified
2Semantic2GraphF1@50%87.3—Unverified
3BaFormerF1@50%83.9—Unverified
4DiffActF1@50%83.7—Unverified
5SF-TMN(ASFormer)F1@50%82.9—Unverified
6LTContextF1@50%82—Unverified
7UVASTF1@50%81.7—Unverified
8Br-Prompt+ASFormerF1@50%81.3—Unverified
9EUTF1@50%81—Unverified
10CETNetF1@50%80.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Semantic2GraphF1@50%91.3—Unverified
2FACTF1@50%87.5—Unverified
3DiffActF1@50%84.7—Unverified
4BaFormerF1@50%83.5—Unverified
5SF-TMN(ASFormer)F1@50%83.1—Unverified
6Br-Prompt+ASFormerF1@50%83—Unverified
7DPRNF1@50%82.9—Unverified
8BITF1@50%82.6—Unverified
9CETNetF1@50%81.3—Unverified
10UVASTF1@50%81—Unverified
#ModelMetricClaimedVerifiedStatus
1UnLoc-LFrame accuracy72.8—Unverified
2UnivlFrame accuracy70—Unverified
3NortonFrame accuracy69.8—Unverified
4VideoClipFrame accuracy68.7—Unverified
5TACoFrame accuracy68.4—Unverified
6VLMFrame accuracy68.4—Unverified
7MIL-NCEFrame accuracy61—Unverified
8ActBERTFrame accuracy57—Unverified
9CBTFrame accuracy53.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ASQueryF1@10%37.8—Unverified
2LTContextF1@10%33.9—Unverified
3ASFormerF1@10%33.4—Unverified
4C2F-TCNF1@10%33.3—Unverified
5UVASTF1@10%32.1—Unverified
6MS-TCN++F1@10%31.6—Unverified
7ProTAS(Offline)F1@10%28.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RL+TreeEdit Distance88.53—Unverified
2RL (full)Edit Distance87.96—Unverified
3TricorNetEdit Distance86.8—Unverified
4SDL+SC-CRFEdit Distance86.21—Unverified
5TCNEdit Distance83.1—Unverified
6ST-CNN+SegEdit Distance66.56—Unverified
#ModelMetricClaimedVerifiedStatus
1TSA (FINCH)Acc62.4—Unverified
2TSA (Kmeans)Acc59.7—Unverified
#ModelMetricClaimedVerifiedStatus
1EUTAcc87.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Unsup. TW-FINCH (K=avg/activity)Accuracy42—Unverified