ChatPaper.aiChatPaper

Make-A-Character:高质量文本到3D角色生成,仅需几分钟

Make-A-Character: High Quality Text-to-3D Character Generation within Minutes

December 24, 2023
作者: Jianqiang Ren, Chao He, Lin Liu, Jiahao Chen, Yutong Wang, Yafei Song, Jianfang Li, Tangli Xue, Siqi Hu, Tao Chen, Kunkun Zheng, Jianjing Xiang, Liefeng Bo
cs.AI

摘要

随着人工智能代理和元宇宙的出现,定制和富有表现力的3D角色需求不断增长,但使用传统计算机图形工具创建3D角色是一项复杂且耗时的任务。为了解决这些挑战,我们提出了一个名为Make-A-Character(Mach)的用户友好框架,用于根据文本描述创建逼真的3D头像。该框架利用大型语言和视觉模型的能力进行文本意图理解和中间图像生成,然后经过一系列面向人类的视觉感知和3D生成模块。我们的系统为用户提供了一种直观的方法,可以在2分钟内打造可控、逼真、完整的3D角色,满足其期望,同时还能轻松与现有计算机图形流程集成,实现动态表现。欲了解更多信息,请访问项目页面:https://human3daigc.github.io/MACH/。
English
There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these challenges, we propose a user-friendly framework named Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions. The framework leverages the power of large language and vision models for textual intention understanding and intermediate image generation, followed by a series of human-oriented visual perception and 3D generation modules. Our system offers an intuitive approach for users to craft controllable, realistic, fully-realized 3D characters that meet their expectations within 2 minutes, while also enabling easy integration with existing CG pipeline for dynamic expressiveness. For more information, please visit the project page at https://human3daigc.github.io/MACH/.
PDF297December 15, 2024