Illuminance-Consistent Dynamic Scene Editing with Phys-based 3D Gaussians and Inverse Rendering
Huang Leyang
Supervisor: Prof. Kenneth K.Y. Wong
About the Project
3D Gaussian Splatting
Utilize 3D Gaussian representation to capture and reconstruct the 3D geometry and appearance of a dynamic scene.
Dynamic Illuminance-Consistency
Develop an approach to maintain the illuminance-consistency in the dynamic scene using inverse rendering techniques.
Object Deformation
Handle deformations and interactions caused by scene editing using methods like deformation field or physics simulation.
User Interaction
Takes user’s editing commands, including moving or deleting objects from the current scene, or adding new objects to the environment, and then outputs a dynamically edited, illuminance-consistent, high-quality scene.
Evaluation
Evaluate the project and compare it with existing state-of-the-art approaches to assess the accuracy, reliability, and efficiency of the dynamic scene reconstruction framework.
Progress
3D Scene Segmentation
Object Removal
3D Scene Inpainting
