角色創造器:在幾分鐘內高品質文字轉3D角色生成
Make-A-Character: High Quality Text-to-3D Character Generation within Minutes
December 24, 2023
作者: Jianqiang Ren, Chao He, Lin Liu, Jiahao Chen, Yutong Wang, Yafei Song, Jianfang Li, Tangli Xue, Siqi Hu, Tao Chen, Kunkun Zheng, Jianjing Xiang, Liefeng Bo
cs.AI
摘要
隨著人工智慧代理和Metaverse的出現,對定制和富有表現力的3D角色的需求正在增長,然而使用傳統的電腦圖形工具創建3D角色是一項複雜且耗時的任務。為應對這些挑戰,我們提出了一個名為Make-A-Character(Mach)的用戶友好框架,用於從文本描述創建逼真的3D頭像。該框架利用大型語言和視覺模型的能力進行文本意圖理解和中間圖像生成,然後通過一系列以人為導向的視覺知覺和3D生成模塊。我們的系統為用戶提供了一種直觀的方法,使他們能夠在2分鐘內創建符合期望的可控、逼真且完整的3D角色,同時還能輕鬆與現有的CG管道進行動態表現的集成。欲獲得更多信息,請訪問項目頁面:https://human3daigc.github.io/MACH/。
English
There is a growing demand for customized and expressive 3D characters with
the emergence of AI agents and Metaverse, but creating 3D characters using
traditional computer graphics tools is a complex and time-consuming task. To
address these challenges, we propose a user-friendly framework named
Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions.
The framework leverages the power of large language and vision models for
textual intention understanding and intermediate image generation, followed by
a series of human-oriented visual perception and 3D generation modules. Our
system offers an intuitive approach for users to craft controllable, realistic,
fully-realized 3D characters that meet their expectations within 2 minutes,
while also enabling easy integration with existing CG pipeline for dynamic
expressiveness. For more information, please visit the project page at
https://human3daigc.github.io/MACH/.