面向一对多时间定位
Towards One-to-Many Temporal Grounding
June 4, 2026
作者: Qi Xu, Yue Tan, Shihao Chen, Jiahao Meng, Anna Wang, Shunping Ji, Hao Fei, Jason Li
cs.AI
摘要
时间定位(Temporal Grounding, TG)旨在定位与文本查询对应的视频片段。现有研究主要集中在单片段检索上。然而,真实场景中往往需要为单个查询定位多个不连续的片段——我们将这一设定称为一对多时间定位(One-to-Many Temporal Grounding, OMTG)。先前在最先进的多模态大语言模型(MLLMs)针对一对一的设定进行了优化,在此背景下表现不佳,常因缺乏事件基数感知而给出近乎为零的分数。为填补这一空白,我们提出了一套系统性解决方案,包含三项关键贡献。首先,我们建立了首个全面的OMTG基准,引入计数准确率(C-Acc)和有效时间F1值(EtF1)作为评估指标。其次,我们通过一个精密的构建流程,整理了一个包含5.6万个样本的高质量OMTG数据集。第三,我们针对OMTG设计了新颖的时间奖励和描述奖励函数。特别地,描述奖励利用基于密集视频描述的思维链推理,显式引导策略优化同时兼顾精确性与完整性。大量实验表明,我们的模型在OMTG基准上达到了43.65%的最新EtF1值,分别比Gemini 2.5 Pro和Seed-1.8高出15.85%和15.61%。
English
Temporal Grounding (TG) aims to localize video segments corresponding to a textual query. Prior research predominantly focuses on single-segment retrieval. Real-world scenarios, however, often require localizing multiple disjoint segments for a single query -- a setting we term One-to-Many Temporal Grounding (OMTG). Previous state-of-the-art MLLMs, optimized for one-to-one settings, struggle in this context, often yielding near-zero scores due to a lack of event cardinality perception. To bridge this gap, we present a systematic solution with three key contributions. First, we establish the first comprehensive OMTG benchmark, introducing Count Accuracy (C-Acc) and Effective Temporal F1 (EtF1) as evaluation metrics. Second, we curate a high-quality OMTG dataset comprising 56k samples through a sophisticated construction pipeline. Third, we develop novel temporal and caption reward functions specifically designed for OMTG. In particular, the caption reward leverages Chain-of-Thought reasoning over dense video captions to explicitly guide policy optimization toward both preciseness and completeness. Extensive experiments show our model achieves a new state-of-the-art EtF1 of 43.65\% on OMTG Bench, outperforming Gemini 2.5 Pro and Seed-1.8 by 15.85\% and 15.61\%, respectively.