Dynamic human rendering with the joint modeling of motion dynamics and appearance.

Unbouned 3D cities generated from 2D image collections!

DiffTF achieves state-of-the-art large-vocabulary 3D object generation performance with 3D-aware transformers.

The first diffusion-model-based text-driven motion generation framework with probabilistic mapping, realistic synthesis and multi-level manipulation ability.

Extension of the CVPR21 Version; Extend DS-Net to 4D panoptic LiDAR segmentation by the temporally unified instance clustering on aligned LiDAR frames.

PrimDiffusion performs the diffusion and denoising process on a set of primitives which compactly represent 3D humans.

To allow artificial intelligence to develop a comprehensive understanding of a 4D world, we introduce 4D Panoptic Scene Graph (PSG-4D), a new representation that bridges the raw visual data perceived in a dynamic 4D world and high-level visual understanding.

Reconstruct human NeRF from a single image in one forward pass!

We learn a style field that deforms real 3D faces to styleized 3D faces.

ReMoDiffuse is a diffusion-model-based motion generation framework that integrates a retrieval mechanism to refine the denoising process, which enhances the generalizability and diversity.

EVA3D is a high-quality unconditional 3D human generative model that only requires 2D image collections for training.

A large-scale multi-modal (color images, point clouds, keypoints, SMPL parameters, and textured meshes) 4D human dataset with 1000 human subjects, 400k sequences and 60M frames.

AvatarCLIP empowers layman users to customize a 3D avatar with the desired shape and texture, and drive the avatar with the described motions using solely natural languages.

The first to leverage the multi-modal nature of human data (e.g. RGB, depth, 2D key-points) for effective human-centric representation learning.

The first attempt at separable and interpretable garment reconstruction from point cloud sequences, especially challenging loose garments.

Rank 1st in the public leaderboard of SemanticKITTI panoptic segmentation (2020-11-16); A learnable clustering module is designed to adapt kernel functions to complex point distributions.

Rank 1st in the public leaderboard of SemanticKITTI semantic segmentation (2020-11-16); Cylindrical 3D convolution is designed to explore the 3D geometric pattern of LiDAR point clouds. Further extend the cylindrical convolution to more general LiDAR-based perception tasks.

To learn discriminative features on point clouds by encoding the fine-grained contexts inside and among local regions simultaneously.

Large Motion Model (LMM) is a motion-centric, multi-modal framework that unifies mainstream motion generation tasks into a generalist model.

StructLDM is a diffusion-based unconditional 3D human generative model learned from 2D images.

FashionEngine is an interactive 3D human generation and editing system with multimodal control (e.g., texts, images, hand-drawing sketches).

Text-to-3D Generation within 5 Minutes! A two-stage design, utilizing both 3D difffusion prior and 2D priors.

We generate 3D digital humans using 3D diffusion model in a controllable, layer-wise way.

SMPL reconstruction from real depth sensor, which are partial point cloud inputs.