LONG-SHORT SKIP CONNECTIONS in DEEP NEURAL NETWORKS for DSM REFINEMENT

K. Bittner, L. Liebel, M. Körner, P. Reinartz

Research output: Contribution to journalConference articlepeer-review

9 Scopus citations

Abstract

Detailed digital surface models (DSMs) from space-borne sensors are the key to successful solutions for many remote sensing problems, like environmental disaster simulations, change detection in rural and urban areas, 3D urban modeling for city planning and management, etc. Traditional methodologies, e.g., stereo matching, used to generate photogrammetric DSMs from stereo imagery, usually deliver low-quality results due to the matching errors in homogeneous areas or the lack of information when observing the scene under different viewing angles. This makes the tasks related to building reconstruction very challenging since in most cases it is difficult to recognize the type of roofs, especially if overlaid with trees. This work represents a continuation of research regarding the automatic optimization of building geometries in photogrammetric DSMs with half-meter resolution and introduces an improved generative adversarial network (GAN) architecture which allows to reconstruct complete and detailed building structures without neglecting even low-rise urban constructions. The generative part of the network is constructed in a way that it simultaneously processes height and intensity information, and combines short and long skip connections within one architecture. To improve different aspects of the surface, several loss terms are used, the contributions of which are automatically balanced during training. The obtained results demonstrate that the proposed methodology can achieve two goals without any manual intervention: improve the roof surfaces by making them more planar and also recognize and optimize even small residential buildings which are hard to detect.

Original languageEnglish
Pages (from-to)383-390
Number of pages8
JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Volume43
Issue numberB2
DOIs
StatePublished - 6 Aug 2020
Event2020 24th ISPRS Congress - Technical Commission II - Nice, Virtual, France
Duration: 31 Aug 20202 Sep 2020

Keywords

  • 3D scene refinement
  • Conditional generative adversarial networks (cGANs)
  • balancing hyper-parameters
  • building geometry
  • long-short skip connections

Fingerprint

Dive into the research topics of 'LONG-SHORT SKIP CONNECTIONS in DEEP NEURAL NETWORKS for DSM REFINEMENT'. Together they form a unique fingerprint.

Cite this