| Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection | Aug 6, 2024 | audio moment retrievalHighlight Detection | CodeCode Available | 3 |
| VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding | May 22, 2024 | Dense Video CaptioningHighlight Detection | CodeCode Available | 2 |
| Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding | Nov 15, 2023 | Highlight DetectionMoment Retrieval | CodeCode Available | 2 |
| UniVTG: Towards Unified Video-Language Temporal Grounding | Jul 31, 2023 | Highlight DetectionMoment Retrieval | CodeCode Available | 2 |
| UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection | Mar 23, 2022 | DecoderHighlight Detection | CodeCode Available | 2 |
| TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detection | Jan 4, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 2 |
| TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning | Oct 25, 2024 | EgoSchemaHallucination | CodeCode Available | 2 |
| TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding | Dec 4, 2023 | Dense CaptioningHighlight Detection | CodeCode Available | 2 |
| Query-Dependent Video Representation for Moment Retrieval and Highlight Detection | Mar 24, 2023 | Highlight DetectionMoment Retrieval | CodeCode Available | 2 |
| Number it: Temporal Grounding Videos like Flipping Manga | Nov 15, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 2 |
| Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval | Jul 21, 2024 | General KnowledgeHighlight Detection | CodeCode Available | 2 |
| Watch Video, Catch Keyword: Context-aware Keyword Attention for Moment Retrieval and Highlight Detection | Jan 5, 2025 | Contrastive LearningHighlight Detection | CodeCode Available | 1 |
| Adaptive Video Highlight Detection by Learning from User History | Jul 19, 2020 | Highlight Detection | CodeCode Available | 1 |
| Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection | Nov 28, 2023 | Contrastive LearningHighlight Detection | CodeCode Available | 1 |
| Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies | Mar 26, 2023 | Highlight DetectionLearning with noisy labels | CodeCode Available | 1 |
| Cross-category Video Highlight Detection via Set-based Learning | Aug 26, 2021 | Domain AdaptationHighlight Detection | CodeCode Available | 1 |
| FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding | Dec 18, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 1 |
| Joint Moment Retrieval and Highlight Detection Via Natural Language Queries | May 8, 2023 | DecoderHighlight Detection | CodeCode Available | 1 |
| LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection | Jan 18, 2025 | Contrastive LearningDecoder | CodeCode Available | 1 |
| M2-Net: Multi-stages Specular Highlight Detection and Removal in Multi-scenes | Jul 20, 2022 | Highlight Detectionhighlight removal | CodeCode Available | 1 |
| MH-DETR: Video Moment and Highlight Detection with Cross-modal Transformer | Apr 29, 2023 | DecoderHighlight Detection | CodeCode Available | 1 |
| PHD-GIFs: Personalized Highlight Detection for Automatic GIF Creation | Apr 18, 2018 | Highlight Detection | CodeCode Available | 1 |
| QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries | Jul 20, 2021 | Highlight DetectionMoment Retrieval | CodeCode Available | 1 |
| Saliency-Guided DETR for Moment Retrieval and Highlight Detection | Oct 2, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 1 |
| Single-Image Specular Highlight Removal via Real-World Dataset Construction | Aug 27, 2021 | Generative Adversarial NetworkHighlight Detection | CodeCode Available | 1 |
| SpecSeg Network for Specular Highlight Detection and Segmentation in Real-World Images | Aug 30, 2022 | Highlight DetectionSpecular Segmentation | CodeCode Available | 1 |
| Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detection | Apr 14, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 1 |
| TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action | May 2, 2025 | Dense CaptioningHighlight Detection | CodeCode Available | 1 |
| Text-Aware Single Image Specular Highlight Removal | Aug 16, 2021 | Highlight Detectionhighlight removal | CodeCode Available | 1 |
| VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval | Dec 2, 2024 | Highlight DetectionMoment Retrieval | CodeCode Available | 1 |
| VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format | Nov 27, 2024 | Dense Video CaptioningGrounded Video Question Answering | CodeCode Available | 1 |
| Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark | Dec 12, 2024 | Highlight DetectionVideo Summarization | CodeCode Available | 1 |
| Learning Pixel-Level Distinctions for Video Highlight Detection | Apr 10, 2022 | Highlight Detection | —Unverified | 0 |
| Less is More: Learning Highlight Detection from Video Duration | Mar 3, 2019 | Highlight Detection | —Unverified | 0 |
| LIGHTS: LIGHT Specularity Dataset for specular detection in Multi-view | Jan 26, 2021 | Highlight Detection | —Unverified | 0 |
| D&M: Enriching E-commerce Videos with Sound Effects by Key Moment Detection and SFX Matching | Aug 23, 2024 | Highlight DetectionMoment Retrieval | —Unverified | 0 |
| Estimating Blink Probability for Highlight Detection in Figure Skating Videos | Jul 2, 2020 | Highlight Detection | —Unverified | 0 |
| TruNet: Short Videos Generation from Long Videos via Story-Preserving Truncation | Oct 14, 2019 | Highlight DetectionVideo Summarization | —Unverified | 0 |
| Gameplay Highlights Generation | May 12, 2025 | Event DetectionHighlight Detection | —Unverified | 0 |
| GPTSee: Enhancing Moment Retrieval and Highlight Detection via Description-Based Similarity Features | Mar 3, 2024 | DecoderHighlight Detection | —Unverified | 0 |
| Highlight Detection With Pairwise Deep Ranking for First-Person Video Summarization | Jun 1, 2016 | Highlight DetectionVideo Summarization | —Unverified | 0 |
| Joint Visual and Audio Learning for Video Highlight Detection | Jan 1, 2021 | Highlight Detection | —Unverified | 0 |
| A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video | Jan 31, 2018 | Highlight Detection | —Unverified | 0 |
| Learning to Detect Specular Highlights from Real-world Images | Oct 10, 2020 | Highlight Detectionobject-detection | —Unverified | 0 |
| Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learning | Mar 14, 2024 | Contrastive LearningHighlight Detection | —Unverified | 0 |
| MINI-Net: Multiple Instance Ranking Network for Video Highlight Detection | Jul 20, 2020 | Highlight Detection | —Unverified | 0 |
| Multi-modal Fusion and Query Refinement Network for Video Moment Retrieval and Highlight Detection | Jan 18, 2025 | AvgHighlight Detection | —Unverified | 0 |
| Automatic Detection of Intro and Credits in Video using CLIP and Multihead Attention | Apr 13, 2025 | CPUHighlight Detection | —Unverified | 0 |
| Unsupervised Multi-stream Highlight detection for the Game "Honor of Kings" | Oct 14, 2019 | Highlight Detection | —Unverified | 0 |
| Audiovisual Highlight Detection in Videos | Feb 11, 2021 | Highlight DetectionObject Recognition | —Unverified | 0 |
