Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification

Chunping Qiu; Michael Schmitt; Xiao Xiang Zhu

doi:10.1109/IGARSS.2019.8898223

Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification

Chunping Qiu
, Michael Schmitt
, Xiao Xiang Zhu

Chair of Data Science in Earth Observation

Technical University of Munich
Deutsches Zentrum für Luft- und Raumfahrt e.V. (DLR)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

This paper proposes a framework to fuse multi-seasonal Sentinel-2 images, with application on LCZ-derived urban land cover classification. Cross-validation over a seven-city study area in central Europe demonstrates its consistently better performance over several previous approaches, with the same experimental setup. Based on our previous work, we can conclude that decision-level fusion is better than feature-level fusion for similar tasks at similar scale with multi-seasonal Sentinel-2 images. With the framework, urban land cover maps of several cities are produced. The visualization of two exemplary areas shows urban structures that are consistent with existing datasets. This framework can be also generally beneficial for other types of urban mapping.

Original language	English
Title of host publication	2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	5037-5040
Number of pages	4
ISBN (Electronic)	9781538691540
DOIs	https://doi.org/10.1109/IGARSS.2019.8898223
State	Published - Jul 2019
Event	39th IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Yokohama, Japan Duration: 28 Jul 2019 → 2 Aug 2019

Publication series

Name	International Geoscience and Remote Sensing Symposium (IGARSS)
ISSN (Print)	2153-6996
ISSN (Electronic)	2153-7003

Conference

Conference	39th IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019
Country/Territory	Japan
City	Yokohama
Period	28/07/19 → 2/08/19

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 11 Sustainable Cities and Communities

Keywords

Classification
Sentinel-2
long short-term memory (LSTM)
residual convolutional neural network (ResNet)
urban land cover

Access to Document

10.1109/IGARSS.2019.8898223

Cite this

Qiu, C., Schmitt, M., & Zhu, X. X. (2019). Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification. In 2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings (pp. 5037-5040). Article 8898223 (International Geoscience and Remote Sensing Symposium (IGARSS) ). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IGARSS.2019.8898223

Qiu, Chunping ; Schmitt, Michael ; Zhu, Xiao Xiang. / Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification. 2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 5037-5040 (International Geoscience and Remote Sensing Symposium (IGARSS) ).

@inproceedings{4983f7ca0a1b462292f679e0723c16a2,

title = "Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification",

abstract = "This paper proposes a framework to fuse multi-seasonal Sentinel-2 images, with application on LCZ-derived urban land cover classification. Cross-validation over a seven-city study area in central Europe demonstrates its consistently better performance over several previous approaches, with the same experimental setup. Based on our previous work, we can conclude that decision-level fusion is better than feature-level fusion for similar tasks at similar scale with multi-seasonal Sentinel-2 images. With the framework, urban land cover maps of several cities are produced. The visualization of two exemplary areas shows urban structures that are consistent with existing datasets. This framework can be also generally beneficial for other types of urban mapping.",

keywords = "Classification, Sentinel-2, long short-term memory (LSTM), residual convolutional neural network (ResNet), urban land cover",

author = "Chunping Qiu and Michael Schmitt and Zhu, \{Xiao Xiang\}",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 39th IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 ; Conference date: 28-07-2019 Through 02-08-2019",

year = "2019",

month = jul,

doi = "10.1109/IGARSS.2019.8898223",

language = "English",

series = "International Geoscience and Remote Sensing Symposium (IGARSS) ",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "5037--5040",

booktitle = "2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings",

}

Qiu, C, Schmitt, M & Zhu, XX 2019, Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification. in 2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings., 8898223, International Geoscience and Remote Sensing Symposium (IGARSS) , Institute of Electrical and Electronics Engineers Inc., pp. 5037-5040, 39th IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019, Yokohama, Japan, 28/07/19. https://doi.org/10.1109/IGARSS.2019.8898223

Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification. / Qiu, Chunping; Schmitt, Michael; Zhu, Xiao Xiang.
2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. p. 5037-5040 8898223 (International Geoscience and Remote Sensing Symposium (IGARSS) ).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification

AU - Qiu, Chunping

AU - Schmitt, Michael

AU - Zhu, Xiao Xiang

PY - 2019/7

Y1 - 2019/7

N2 - This paper proposes a framework to fuse multi-seasonal Sentinel-2 images, with application on LCZ-derived urban land cover classification. Cross-validation over a seven-city study area in central Europe demonstrates its consistently better performance over several previous approaches, with the same experimental setup. Based on our previous work, we can conclude that decision-level fusion is better than feature-level fusion for similar tasks at similar scale with multi-seasonal Sentinel-2 images. With the framework, urban land cover maps of several cities are produced. The visualization of two exemplary areas shows urban structures that are consistent with existing datasets. This framework can be also generally beneficial for other types of urban mapping.

AB - This paper proposes a framework to fuse multi-seasonal Sentinel-2 images, with application on LCZ-derived urban land cover classification. Cross-validation over a seven-city study area in central Europe demonstrates its consistently better performance over several previous approaches, with the same experimental setup. Based on our previous work, we can conclude that decision-level fusion is better than feature-level fusion for similar tasks at similar scale with multi-seasonal Sentinel-2 images. With the framework, urban land cover maps of several cities are produced. The visualization of two exemplary areas shows urban structures that are consistent with existing datasets. This framework can be also generally beneficial for other types of urban mapping.

KW - Classification

KW - Sentinel-2

KW - long short-term memory (LSTM)

KW - residual convolutional neural network (ResNet)

KW - urban land cover

UR - https://www.scopus.com/pages/publications/85077693384

U2 - 10.1109/IGARSS.2019.8898223

DO - 10.1109/IGARSS.2019.8898223

M3 - Conference contribution

AN - SCOPUS:85077693384

T3 - International Geoscience and Remote Sensing Symposium (IGARSS)

SP - 5037

EP - 5040

BT - 2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 39th IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019

Y2 - 28 July 2019 through 2 August 2019

ER -

Qiu C, Schmitt M, Zhu XX. Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification. In 2019 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. p. 5037-5040. 8898223. (International Geoscience and Remote Sensing Symposium (IGARSS) ). doi: 10.1109/IGARSS.2019.8898223

Fusing Multi-Seasonal Sentinel-2 Images with Residual Convolutional Neural Networks for Local Climate Zone-Derived Urban Land Cover Classification

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this