Log in to save to my catalogue

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_proquest_journals_2568817352

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

About this item

Full title

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

Publisher

Ithaca: Cornell University Library, arXiv.org

Journal title

arXiv.org, 2021-09

Language

English

Formats

Publication information

Publisher

Ithaca: Cornell University Library, arXiv.org

More information

Scope and Contents

Contents

Single image 3D photography enables viewers to view a still image from novel viewpoints. Recent approaches combine monocular depth networks with inpainting networks to achieve compelling results. A drawback of these techniques is the use of hard depth layering, making them unable to model intricate appearance details such as thin hair-like structures. We present SLIDE, a modular and unified system for single image 3D photography that uses a simple yet effective soft layering strategy to better preserve appearance details in novel views. In addition, we propose a novel depth-aware training strategy for our inpainting module, better suited for the 3D photography task. The resulting SLIDE approach is modular, enabling the use of other components such as segmentation and matting for improved layering. At the same time, SLIDE uses an efficient layered depth formulation that only requires a single forward pass through the component networks to produce high quality 3D photos. Extensive experimental analysis on three view-synthesis datasets, in combination with user studies on in-the-wild image collections, demonstrate superior performance of our technique in comparison to existing strong baselines while being conceptually much simpler. Project page: https://varunjampani.github.io/slide...

Alternative Titles

Full title

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

Identifiers

Primary Identifiers

Record Identifier

TN_cdi_proquest_journals_2568817352

Permalink

https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_proquest_journals_2568817352

Other Identifiers

E-ISSN

2331-8422

How to access this item