Learning an Isometric Surface Parameterization for Texture Unwrapping

Sagnik Das     Ke Ma     Zhixin Shu     Dimitris Samaras

Stony Brook University, New York, USA

Abstract: In this paper, we present a novel approach to learn texture mapping for an isometrically deformed 3D surface and apply it for texture unwrapping of documents or other objects. Recent work on differentiable rendering techniques for implicit surfaces has shown high-quality 3D scene reconstruction and view synthesis results. However, these methods typically learn the appearance color as a function of the surface points and lack explicit surface parameterization. Thus they do not allow texture map extraction or texture editing. We propose an efficient method to learn surface parameterization by learning a continuous bijective mapping between 3D surface positions and 2D texture space coordinates. Our surface parameterization network can be conveniently plugged into a differentiable rendering pipeline and trained using multi-view images and rendering loss. Using the learned parameterized implicit 3D surface we demonstrate state-of-the-art document-unwarping via texture extraction in both synthetic and real scenarios. We also show that our approach can reconstruct high-frequency textures for arbitrary objects. We further demonstrate the usefulness of our system by applying it to document and object texture editing.

PDF   Supplementary   Code   Poster  

Additional Video Results

Cite Our Work

If this project is useful to you, please consider citing our paper:

author={Das, Sagnik and Ma, Ke and Shu, Zhixin and Samaras, Dimitris},
title={Learning an Isometric Surface Parameterization for Texture Unwrapping},
booktitle = {European Conference on Computer Vision (ECCV)}, month = {October},
year = {2022}}


If you have any questions about the project, please feel free to contact-

Sagnik Das [email]