Toon3D：以新视角看动画

摘要

在这项工作中，我们恢复了非几何一致场景的底层3D结构。我们的分析重点放在来自卡通和动漫的手绘图像上。许多卡通是由艺术家创作的，没有使用3D渲染引擎，这意味着场景的任何新图像都是手绘的。手绘图像通常是对世界的忠实表现，但只是在定性上，因为人类很难连续绘制一个物体或场景的多个视角的3D。尽管如此，人们可以轻松地从不一致的输入中感知3D场景！在这项工作中，我们校正了2D绘图不一致性，恢复了一个合理的3D结构，使新变形的绘图彼此一致。我们的流程包括一个用户友好的注释工具、相机姿态估计和图像变形，以恢复密集结构。我们的方法将图像扭曲以遵守透视相机模型，使我们对齐的结果能够被插入新视角合成重建方法，以体验以前未绘制过的卡通视角。我们的项目页面是https://toon3d.studio/。

English

In this work, we recover the underlying 3D structure of non-geometrically consistent scenes. We focus our analysis on hand-drawn images from cartoons and anime. Many cartoons are created by artists without a 3D rendering engine, which means that any new image of a scene is hand-drawn. The hand-drawn images are usually faithful representations of the world, but only in a qualitative sense, since it is difficult for humans to draw multiple perspectives of an object or scene 3D consistently. Nevertheless, people can easily perceive 3D scenes from inconsistent inputs! In this work, we correct for 2D drawing inconsistencies to recover a plausible 3D structure such that the newly warped drawings are consistent with each other. Our pipeline consists of a user-friendly annotation tool, camera pose estimation, and image deformation to recover a dense structure. Our method warps images to obey a perspective camera model, enabling our aligned results to be plugged into novel-view synthesis reconstruction methods to experience cartoons from viewpoints never drawn before. Our project page is https://toon3d.studio/.

Toon3D：以新视角看动画

Toon3D: Seeing Cartoons from a New Perspective

摘要

Support