GPT 模型遇上機器人應用：共語手勢聊天系統

GPT Models Meet Robotic Applications: Co-Speech Gesturing Chat System

May 10, 2023

作者: Naoki Wake, Atsushi Kanehira, Kazuhiro Sasabuchi, Jun Takamatsu, Katsushi Ikeuchi

cs.AI

摘要

本技術論文介紹了一個使用最近大規模語言模型（LLM）如GPT-3和ChatGPT的對話機器人系統。該系統集成了一個共話手勢生成系統，根據語音的概念含義選擇適當的手勢。我們的動機是探索如何利用LLM的最新進展來進行實際機器人應用，這有助於聊天機器人和LLM的發展。具體來說，通過利用LLM實現高度響應的聊天機器人系統的開發，並將視覺效果添加到LLM的用戶界面作為附加價值。系統的源代碼可在GitHub上找到，分別針對我們內部機器人（https://github.com/microsoft/LabanotationSuite/tree/master/MSRAbotChatSimulation）和Toyota HSR（https://github.com/microsoft/GPT-Enabled-HSR-CoSpeechGestures）。

English

This technical paper introduces a chatting robot system that utilizes recent advancements in large-scale language models (LLMs) such as GPT-3 and ChatGPT. The system is integrated with a co-speech gesture generation system, which selects appropriate gestures based on the conceptual meaning of speech. Our motivation is to explore ways of utilizing the recent progress in LLMs for practical robotic applications, which benefits the development of both chatbots and LLMs. Specifically, it enables the development of highly responsive chatbot systems by leveraging LLMs and adds visual effects to the user interface of LLMs as an additional value. The source code for the system is available on GitHub for our in-house robot (https://github.com/microsoft/LabanotationSuite/tree/master/MSRAbotChatSimulation) and GitHub for Toyota HSR (https://github.com/microsoft/GPT-Enabled-HSR-CoSpeechGestures).