Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videos

GIA

SGIA: We achieve fast reconstruction of clothed human avatars with PBR properties from a monocular video. SGIA takes a monocular video and initial human pose and shape as input to estimate dynamic clothed humans' PBR properties, including geometry and materials. Leveraging a PBR-aware 2DGS representation, our method enables fast training and rendering processes. By utilizing the estimated PBR properties, we can not only deform the avatars into different poses but also render them with realistic lighting conditions, allowing for versatile and visually appealing outputs.

Main Experiment Comparison

Select Training/Novel pose to compare.

(Please refresh if you don't see the video. Switch video will need some time to process.)

Baselines    VS    Ours

Novel Pose Animation at different View under different illumination

(Please refresh if you don't see the video. Switch video will need some time to process.)



(Click here to switch the Subject)

Novel lighing results on zju mocap dataset