创形者：数分钟内实现高质量文本到3D角色生成

Make-A-Character: High Quality Text-to-3D Character Generation within Minutes

December 24, 2023

作者: Jianqiang Ren, Chao He, Lin Liu, Jiahao Chen, Yutong Wang, Yafei Song, Jianfang Li, Tangli Xue, Siqi Hu, Tao Chen, Kunkun Zheng, Jianjing Xiang, Liefeng Bo

cs.AI

摘要

随着AI智能体与元宇宙的兴起，市场对定制化、高表现力3D角色的需求日益增长，但使用传统计算机图形工具创建3D角色仍是复杂且耗时的任务。为应对这些挑战，我们提出名为Make-A-Character（简称Mach）的易用框架，能够通过文本描述生成逼真的3D虚拟形象。该框架依托大语言模型与视觉模型实现文本意图理解与中间图像生成，继而通过一系列面向人类的视觉感知与3D生成模块，为用户提供直观的角色创作方案。我们的系统支持用户在2分钟内制作出符合预期、可操控且细节完备的逼真3D角色，同时能便捷接入现有CG工作流以实现动态表情表现。更多信息请访问项目页面：https://human3daigc.github.io/MACH/。

English

There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these challenges, we propose a user-friendly framework named Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions. The framework leverages the power of large language and vision models for textual intention understanding and intermediate image generation, followed by a series of human-oriented visual perception and 3D generation modules. Our system offers an intuitive approach for users to craft controllable, realistic, fully-realized 3D characters that meet their expectations within 2 minutes, while also enabling easy integration with existing CG pipeline for dynamic expressiveness. For more information, please visit the project page at https://human3daigc.github.io/MACH/.