GPT 模型遇见机器人应用：共语手势聊天系统

GPT Models Meet Robotic Applications: Co-Speech Gesturing Chat System

May 10, 2023

作者: Naoki Wake, Atsushi Kanehira, Kazuhiro Sasabuchi, Jun Takamatsu, Katsushi Ikeuchi

cs.AI

摘要

本技术论文介绍了一个聊天机器人系统，利用了最近大规模语言模型（LLMs）的进展，如GPT-3和ChatGPT。该系统集成了一个共语手势生成系统，根据语音的概念含义选择适当的手势。我们的动机是探索如何利用LLMs的最新进展来实现实际机器人应用，这有利于聊天机器人和LLMs的发展。具体来说，它通过利用LLMs实现高度响应的聊天机器人系统的开发，并为LLMs的用户界面添加视觉效果，从而增加附加值。该系统的源代码可在GitHub上找到，用于我们内部机器人（https://github.com/microsoft/LabanotationSuite/tree/master/MSRAbotChatSimulation）和丰田HSR（https://github.com/microsoft/GPT-Enabled-HSR-CoSpeechGestures）。

English

This technical paper introduces a chatting robot system that utilizes recent advancements in large-scale language models (LLMs) such as GPT-3 and ChatGPT. The system is integrated with a co-speech gesture generation system, which selects appropriate gestures based on the conceptual meaning of speech. Our motivation is to explore ways of utilizing the recent progress in LLMs for practical robotic applications, which benefits the development of both chatbots and LLMs. Specifically, it enables the development of highly responsive chatbot systems by leveraging LLMs and adds visual effects to the user interface of LLMs as an additional value. The source code for the system is available on GitHub for our in-house robot (https://github.com/microsoft/LabanotationSuite/tree/master/MSRAbotChatSimulation) and GitHub for Toyota HSR (https://github.com/microsoft/GPT-Enabled-HSR-CoSpeechGestures).