RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Dataset

Zhongjin Luo1*      Shengcai Cai1,3*      Jinguo Dong1      Ruibo Ming1,4     

Liangdong Qiu2,1      Xiaohang Zhan3      Xiaoguang Han1,2#     

#Corresponding email: hanxiaoguang@cuhk.edu.cn

1SSE, CUHKSZ       2FNii, CUHKSZ      

3Huawei Technologies Co., Ltd.       4Tsinghua University      

CVPR 2023

Paper Dataset Project Code

Abstract

Assisting people in efficiently producing visually plausible 3D characters has always been a fundamental research topic in computer vision and computer graphics. Recent learning-based approaches have achieved unprecedented accuracy and efficiency in the area of 3D real human digitization. However, none of the prior works focus on modeling 3D biped cartoon characters, which are also in great demand in gaming and filming. In this paper, we introduce 3DBiCar, the first large-scale dataset of 3D biped cartoon characters, and RaBit, the corresponding parametric model. Our dataset contains 1,500 topologically consistent high-quality 3D textured models which are manually crafted by professional artists. Built upon the data, RaBit is thus designed with a SMPL-like linear blend shape model and a StyleGAN-based neural UV-texture generator, simultaneously expressing the shape, pose, and texture. To demonstrate the practicality of 3DBiCar and RaBit, various applications are conducted, including single-view reconstruction, sketch-based modeling, and 3D cartoon animation. For the single-view reconstruction setting, we find a straightforward global mapping from input images to the output UV-based texture maps tends to lose detailed appearances of some local parts (e.g., nose, ears). Thus, a novel part-sensitive texture reasoner is designed to make all important local areas perceived. Experiments further demonstrate the effectiveness of such a novel design, both qualitatively and quantitatively. We will release both 3DBiCar and RaBit to the research community.


The First Large-Scale Dataset of 3D Biped Cartoon Characters
An illustration of our proposed dataset.
Data Statistics
Chart (a) illustrates the number of 15 species of bipedal cartoon characters in 3DBiCar.
Chart (b) shows the number of four styles of reference images collected in 3DBiCar.
Representative Examples
The gallery of the representative examples sampled from 3DBiCar.
Rich Data Items
An illustration of various forms of data for each character. Click here for more details.

RaBit

The First 3D Full-body Cartoon Parametric Model for Biped Character Modeling
An illustration of  RaBit.
Interpolating on The Parametric Space
Interpolating on RaBit's parametric space.
Sampling on The Parametric Space
Random sampling on RaBit's parametric space.

BiCarNet

The First Method to Reconstruct 3D Biped Cartoon Characters from Single-View Images
The pipeline of BiCarNet.
Representative Results
Results gallery of BiCarNet.

More Applications

Sketch-Based Modeling
An illustration of sketch-based modeling.
3D Character Animation
An illustration of 3D character animation.

The website template is borrowed from DreamFusion.