带有自我中心记忆的混合对话会话

Mixed-Session Conversation with Egocentric Memory

October 3, 2024

作者: Jihyoung Jang, Taeyoung Kim, Hyounghun Kim

cs.AI

摘要

最近推出的对话系统展示了很高的可用性。然而，它们仍然无法反映现实世界中的对话场景。当前的对话系统表现出无法复制动态、连续、长期涉及多个参与者的互动的能力。这种不足是由于对现实世界对话的两个方面的考虑努力有限而产生的：长期对话中深层次的互动以及涉及多个参与者的广泛扩展的对话网络。随着结合这些方面的努力，我们引入了混合会话（Mixed-Session Conversation），这是一个旨在在多个对话环境中与不同伙伴构建对话的对话系统。我们提出了一个名为MiSC的新数据集来实现这个系统。MiSC的对话情节包括6个连续的会话，每个情节中有四名发言者（一个主发言者和三名伙伴）。此外，我们提出了一种新的对话模型，具有一种新颖的记忆管理机制，称为自我中心记忆增强混合会话代理（EMMA）。EMMA在与伙伴对话时从主发言者的视角收集和保留记忆，从而在随后的互动中实现无缝连续性。广泛的人类评估验证了MiSC中的对话展示了无缝的对话流程，即使在每个会话中伙伴发生变化。经过MiSC训练的EMMA也被评估为在整个对话过程中保持高的可记忆性而没有矛盾。

English

Recently introduced dialogue systems have demonstrated high usability. However, they still fall short of reflecting real-world conversation scenarios. Current dialogue systems exhibit an inability to replicate the dynamic, continuous, long-term interactions involving multiple partners. This shortfall arises because there have been limited efforts to account for both aspects of real-world dialogues: deeply layered interactions over the long-term dialogue and widely expanded conversation networks involving multiple participants. As the effort to incorporate these aspects combined, we introduce Mixed-Session Conversation, a dialogue system designed to construct conversations with various partners in a multi-session dialogue setup. We propose a new dataset called MiSC to implement this system. The dialogue episodes of MiSC consist of 6 consecutive sessions, with four speakers (one main speaker and three partners) appearing in each episode. Also, we propose a new dialogue model with a novel memory management mechanism, called Egocentric Memory Enhanced Mixed-Session Conversation Agent (EMMA). EMMA collects and retains memories from the main speaker's perspective during conversations with partners, enabling seamless continuity in subsequent interactions. Extensive human evaluations validate that the dialogues in MiSC demonstrate a seamless conversational flow, even when conversation partners change in each session. EMMA trained with MiSC is also evaluated to maintain high memorability without contradiction throughout the entire conversation.