ChatPaper.aiChatPaper

創建角色:數分鐘內實現高品質文本到3D角色生成

Make-A-Character: High Quality Text-to-3D Character Generation within Minutes

December 24, 2023
作者: Jianqiang Ren, Chao He, Lin Liu, Jiahao Chen, Yutong Wang, Yafei Song, Jianfang Li, Tangli Xue, Siqi Hu, Tao Chen, Kunkun Zheng, Jianjing Xiang, Liefeng Bo
cs.AI

摘要

隨著AI智慧體與元宇宙的興起,市場對個性化、高表現力3D角色的需求日益增長,但使用傳統電腦圖形工具創建3D角色仍是複雜且耗時的任務。為解決這些難題,我們提出名為Make-A-Character(簡稱Mach)的用戶友好框架,可透過文字描述生成逼真的3D虛擬形象。該框架運用大型語言與視覺模型實現文本意圖理解與中間影像生成,並結合一系列以人為本的視覺感知與3D生成模組。我們的系統讓用戶能於2分鐘內直觀地創建出符合預期、可控且真實的完整3D角色,同時可無縫對接現有CG流程以實現動態表情表現。更多詳情請訪問項目頁面:https://human3daigc.github.io/MACH/。
English
There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these challenges, we propose a user-friendly framework named Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions. The framework leverages the power of large language and vision models for textual intention understanding and intermediate image generation, followed by a series of human-oriented visual perception and 3D generation modules. Our system offers an intuitive approach for users to craft controllable, realistic, fully-realized 3D characters that meet their expectations within 2 minutes, while also enabling easy integration with existing CG pipeline for dynamic expressiveness. For more information, please visit the project page at https://human3daigc.github.io/MACH/.
PDF287December 15, 2024