Structurally Disentangled Feature Fields Distillation for 3D Understanding and Editing
More Results
Segmentation
Segmentation of 3D objects in scenes using our full approach in comaprison to baselines.
Our approach is shown in the first row, DFF is shown in the second row, and DFF+RefNeRF is shown in the third row.
The first 6 scenes are real world scenes from the real-world RefNeRF dataset and MipNeRF-360 dataset.
The remaining scenes are synthetic scenes from the shiny blender dataset. The DFF and DFF+RefNeRF baselines mask the intended objects partially or include parts of other regions.
In contrast, our method produces a more accurate and complete segmentation of the desired region.
Gardenspheres
Novel Views - Gardenspheres
Segmented - Spheres
Segmented - Head Statue
Segmented - Cone
Ours
DFF
DFF+RefNeRF
Sedan
Novel Views - Sedan
Segmented - Bonnet Top
Segmented - Wheels
Segmented - Hubcaps
Segmented - Windshield
Ours
DFF
DFF+RefNeRF
Toycar
Novel Views - Toycar
Segmented - Body
Segmented - Wheels
Ours
DFF
DFF+RefNeRF
Bicycle
Novel Views - Bicycle
Segmented - Wheels
Segmented - Bench
Ours
DFF
DFF+RefNeRF
Garden
Novel Views - Garden
Segmented - Plant
Segmented - Table top
Segmented - Ball
Ours
DFF
DFF+RefNeRF
Kitchen
Novel Views - Kitchen
Segmented - Lego Tractor
Ours
DFF
Counter
Novel Views - Counter
Segmented - Mittens
Segmented - Tray
Segmented - Plant
Ours
DFF
DFF+RefNeRF
Car
Novel Views - Car
Segmented - Wheels
Segmented - Windshield
Ours
DFF
DFF+RefNeRF
Helmet
Novel Views - Helmet
Segmented - Windshield
Segmented - Body
Ours
DFF
DFF+RefNeRF
Toaster
Novel Views - Toaster
Segmented - Body
Segmented - Toasts
Ours
DFF
DFF+RefNeRF
Teapot
Novel Views - Teapot
Segmented - Cover
Ours
DFF
DFF+RefNeRF
View Dependent Segmentation
Gardenspheres
Novel Views - Gardenspheres
Segmented - Spheres Highlight
Sedan
Segmented - Windshield Highlight
Car
Segmented - Car Highlight
Helmet
Segmented - Body Highlight
Removal and Editing
The following are additional novel views for different removal and editing capabilites.
We also provide additional illustrations beyond those provided in the manuscript for additional scenes.
Gardenspheres (Color Editing of Spheres)
Full Color Edit - Spheres
Independent Color Edit 1 - Spheres
Independent Color Edit 2 - Spheres
Independent Color Edit 3 - Spheres
Garden (Color Editing of Plant and Tabletop)
Color Edit - Plant
Color Edit 2 - Plant
Color Edit - Tabletop
Color Edit 2 - Tabletop
Toaster (Color Editing of Toaster Body or Toast)
Novel Views
Edit the entire color component of body
Edit independent color component of body
Edit the entire color component of toast
Edit independent color component of toast
Sedan (Color Editing of Sedan Wheel or Windshield)
Red Wheel Steel
Yellow Windshield
Car (Color Editing of Car's Body or Wheels)
Blue Wheels (Using independent component)
Blue Wheels (Using entire color component)
Purple Body (Using independent component)
Purple Body (Using entire color component)
Gardenspheres (Rougher Spheres)
Purple Body (Using independent component)
Helmet (Rougher Body)
Novel Views
Rougher Body
Toaster (Rougher Body)
Shiny Toasts
Rougher Toaster Body
Car (Rougher Body or Shiny Wheels)
Shiny Wheels
Rougher Body
Removal Of Reflective Component of Tabletop
Remove Garden Tabletop Reflection
Remove Sedan Bonet+Top Reflection
Remove Gardenspheres Spheres Reflection
Ground Truth Segmentation Masks
We provide here illustration of ground truth segmentation masks used for the computation of the IoU. These were obtained using Segment Anything and manully refined.
