创意故事生成的集体评论者

Collective Critics for Creative Story Generation

October 3, 2024

作者: Minwook Bae, Hyounghun Kim

cs.AI

摘要

利用大型语言模型（LLMs）生成几千字长的具有叙事连贯性的故事一直是一项具有挑战性的任务。先前的研究通过提出不同的框架来解决这一挑战，这些框架创建故事计划并基于该计划生成长篇故事。然而，这些框架主要关注于在故事中保持叙事连贯性，往往忽视了故事规划中的创造力以及从这些计划中生成的故事的表现力，这些是吸引读者兴趣的理想特性。在本文中，我们提出了用于创造性故事生成的集体评论者框架（CritiCS），该框架由计划细化阶段（CrPlan）和故事生成阶段（CrText）组成，以整合促进这些特性的集体修订机制到长篇故事生成过程中。具体而言，在每个阶段，一组LLM评论者和一位领导者合作，通过多轮逐渐完善计划和故事草稿。广泛的人类评估显示，CritiCS能够显著增强故事的创造力和读者参与度，同时保持叙事连贯性。此外，该框架的设计允许人类作者在评论过程中的任何角色中积极参与，实现了人机互动合作进行故事创作。

English

Generating a long story of several thousand words with narrative coherence using Large Language Models (LLMs) has been a challenging task. Previous research has addressed this challenge by proposing different frameworks that create a story plan and generate a long story based on that plan. However, these frameworks have been mainly focusing on maintaining narrative coherence in stories, often overlooking creativity in story planning and the expressiveness of the stories generated from those plans, which are desirable properties to captivate readers' interest. In this paper, we propose Collective Critics for Creative Story Generation framework (CritiCS), which is composed of plan refining stage (CrPlan) and story generation stage (CrText), to integrate a collective revision mechanism that promotes those properties into long-form story generation process. Specifically, in each stage, a group of LLM critics and one leader collaborate to incrementally refine drafts of plan and story throughout multiple rounds. Extensive human evaluation shows that the CritiCS can significantly enhance story creativity and reader engagement, while also maintaining narrative coherence. Furthermore, the design of the framework allows active participation from human writers in any role within the critique process, enabling interactive human-machine collaboration in story writing.