| HFGCN:Hypergraph Fusion Graph Convolutional Networks for Skeleton-Based Action Recognition | Jan 19, 2025 | Action RecognitionRelation Classification | —Unverified | 0 |
| Facial Dynamics in Video: Instruction Tuning for Improved Facial Expression Perception and Contextual Awareness | Jan 14, 2025 | Event ExtractionInstruction Following | CodeCode Available | 1 |
| AVS-Mamba: Exploring Temporal and Multi-modal Mamba for Audio-Visual Segmentation | Jan 14, 2025 | MambaVideo Understanding | CodeCode Available | 1 |
| Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understanding | Jan 14, 2025 | Embodied Question AnsweringHallucination | CodeCode Available | 4 |
| Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Marks | Jan 14, 2025 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Video Quality Assessment for Online Processing: From Spatial to Temporal Sampling | Jan 13, 2025 | Video Quality AssessmentVideo Understanding | —Unverified | 0 |
| MECD+: Unlocking Event-Level Causal Graph Discovery for Video Reasoning | Jan 13, 2025 | Causal DiscoveryCausal Inference | CodeCode Available | 1 |
| VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning | Jan 12, 2025 | Dense Video CaptioningVideo Captioning | CodeCode Available | 1 |
| X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding | Jan 12, 2025 | Video Understanding | —Unverified | 0 |
| Zero-shot Shark Tracking and Biometrics from Aerial Imagery | Jan 10, 2025 | Video Understanding | —Unverified | 0 |
| From My View to Yours: Ego-Augmented Learning in Large Vision Language Models for Understanding Exocentric Daily Living Activities | Jan 10, 2025 | Human-Object Interaction DetectionKnowledge Distillation | CodeCode Available | 1 |
| Valley2: Exploring Multimodal Models with Scalable Vision-Language Design | Jan 10, 2025 | Image CaptioningLanguage Modeling | CodeCode Available | 3 |
| OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding? | Jan 9, 2025 | BenchmarkingVideo Understanding | CodeCode Available | 2 |
| LLaVA-Octopus: Unlocking Instruction-Driven Adaptive Projector Fusion for Video Understanding | Jan 9, 2025 | Language ModelingLanguage Modelling | —Unverified | 0 |
| LongViTU: Instruction Tuning for Long-Form Video Understanding | Jan 9, 2025 | EgoSchemaForm | —Unverified | 0 |
| Building a Mind Palace: Structuring Environment-Grounded Semantic Graphs for Effective Long Video Analysis with LLMs | Jan 8, 2025 | EgoSchemaObject Tracking | —Unverified | 0 |
| H-MBA: Hierarchical MamBa Adaptation for Multi-Modal Video Understanding in Autonomous Driving | Jan 8, 2025 | Autonomous DrivingMamba | —Unverified | 0 |
| MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Models | Jan 6, 2025 | BenchmarkingFeature Compression | —Unverified | 0 |
| HLV-1K: A Large-scale Hour-Long Video Benchmark for Time-Specific Long Video Understanding | Jan 3, 2025 | Question AnsweringVideo Understanding | CodeCode Available | 0 |
| Unifying Specialized Visual Encoders for Video Language Models | Jan 2, 2025 | Multiple-choiceVideo Understanding | CodeCode Available | 1 |
| Mamba4D: Efficient 4D Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models | Jan 1, 2025 | Action RecognitionAction Segmentation | CodeCode Available | 1 |
| Q-Bench-Video: Benchmark the Video Quality Understanding of LMMs | Jan 1, 2025 | Multiple-choiceVideo Generation | —Unverified | 0 |
| HierarQ: Task-Aware Hierarchical Q-Former for Enhanced Video Understanding | Jan 1, 2025 | Question AnsweringVideo Understanding | —Unverified | 0 |
| Video Language Model Pretraining with Spatio-temporal Masking | Jan 1, 2025 | DecoderLanguage Modeling | —Unverified | 0 |
| Adaptive Keyframe Sampling for Long Video Understanding | Jan 1, 2025 | Video Understanding | CodeCode Available | 2 |
| HuMoCon: Concept Discovery for Human Motion Understanding | Jan 1, 2025 | Video Understanding | —Unverified | 0 |
| Adapting Pre-trained 3D Models for Point Cloud Video Understanding via Cross-frame Spatio-temporal Perception | Jan 1, 2025 | Autonomous DrivingGesture Recognition | —Unverified | 0 |
| AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction | Jan 1, 2025 | GPUQuestion Answering | —Unverified | 0 |
| Efficient Motion-Aware Video MLLM | Jan 1, 2025 | Question AnsweringVideo Question Answering | —Unverified | 0 |
| Language-Guided Audio-Visual Learning for Long-Term Sports Assessment | Jan 1, 2025 | audio-visual learningKnowledge Graphs | CodeCode Available | 1 |
| VEU-Bench: Towards Comprehensive Understanding of Video Editing | Jan 1, 2025 | Video EditingVideo Understanding | —Unverified | 0 |
| Flexible Frame Selection for Efficient Video Reasoning | Jan 1, 2025 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Weakly Supervised Temporal Action Localization via Dual-Prior Collaborative Learning Guided by Multimodal Large Language Models | Jan 1, 2025 | Action LocalizationTemporal Action Localization | —Unverified | 0 |
| OV-HHIR: Open Vocabulary Human Interaction Recognition Using Cross-modal Integration of Large Language Models | Dec 31, 2024 | Activity RecognitionHuman Interaction Recognition | —Unverified | 0 |
| Online Video Understanding: OVBench and VideoChat-Online | Dec 31, 2024 | Autonomous DrivingQuestion Answering | CodeCode Available | 2 |
| CaReBench: A Fine-Grained Benchmark for Video Captioning and Retrieval | Dec 31, 2024 | RetrievalText Retrieval | —Unverified | 0 |
| VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM | Dec 31, 2024 | ObjectVideo Understanding | CodeCode Available | 3 |
| Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understanding | Dec 31, 2024 | Robot ManipulationScene Understanding | —Unverified | 0 |
| FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models | Dec 30, 2024 | Question AnsweringToken Reduction | CodeCode Available | 2 |
| Detection-Fusion for Knowledge Graph Extraction from Videos | Dec 30, 2024 | Knowledge GraphsLanguage Modeling | CodeCode Available | 0 |
| ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding | Dec 29, 2024 | Video CompressionVideo Understanding | CodeCode Available | 1 |
| MVTamperBench: Evaluating Robustness of Vision-Language Models | Dec 27, 2024 | Video Understanding | —Unverified | 0 |
| Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries | Dec 26, 2024 | Question AnsweringVideo Question Answering | —Unverified | 0 |
| HumanVBench: Exploring Human-Centric Video Understanding Capabilities of MLLMs with Synthetic Benchmark Data | Dec 23, 2024 | Action RecognitionVideo Understanding | —Unverified | 0 |
| Video Domain Incremental Learning for Human Action Recognition in Home Environments | Dec 22, 2024 | Action Recognitionclass-incremental learning | —Unverified | 0 |
| FriendsQA: A New Large-Scale Deep Video Understanding Dataset with Fine-grained Topic Categorization for Story Videos | Dec 22, 2024 | Language ModellingLarge Language Model | CodeCode Available | 0 |
| PruneVid: Visual Token Pruning for Efficient Video Large Language Models | Dec 20, 2024 | Video Understanding | CodeCode Available | 2 |
| FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding | Dec 18, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 1 |
| InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models | Dec 18, 2024 | Reasoning SegmentationSegmentation | CodeCode Available | 2 |
| Do Language Models Understand Time? | Dec 18, 2024 | Action RecognitionAnomaly Detection | CodeCode Available | 1 |
