通过程序综合实现自然语言命令

摘要

我们提出了语义解释器（Semantic Interpreter），这是一个面向生产力软件（如Microsoft Office）的自然语言友好型人工智能系统，利用大型语言模型（LLMs）来执行用户意图跨应用程序功能。虽然LLMs擅长理解以自然语言表达的用户意图，但对于实现需要超出文本到文本转换的特定应用程序用户意图来说并不足够。因此，我们引入了Office领域特定语言（ODSL），这是一种简洁、高级的语言，专门用于在Office应用程序中执行操作并与实体交互。语义解释器利用分析-检索提示构建方法与LLMs进行程序合成，将自然语言用户话语翻译为可以转译为应用程序API并随后执行的ODSL程序。我们的讨论主要集中在针对Microsoft PowerPoint 的研究探索上。

English

We present Semantic Interpreter, a natural language-friendly AI system for productivity software such as Microsoft Office that leverages large language models (LLMs) to execute user intent across application features. While LLMs are excellent at understanding user intent expressed as natural language, they are not sufficient for fulfilling application-specific user intent that requires more than text-to-text transformations. We therefore introduce the Office Domain Specific Language (ODSL), a concise, high-level language specialized for performing actions in and interacting with entities in Office applications. Semantic Interpreter leverages an Analysis-Retrieval prompt construction method with LLMs for program synthesis, translating natural language user utterances to ODSL programs that can be transpiled to application APIs and then executed. We focus our discussion primarily on a research exploration for Microsoft PowerPoint.

通过程序综合实现自然语言命令

Natural Language Commanding via Program Synthesis

摘要

Support