SCIDA: Self-Correction Integrated Domain Adaptation from Single- to Multi-Label Aerial Images

Tianze Yu, Jianzhe Lin, Lichao Mou, Yuansheng Hua, Xiaoxiang Zhu, Z. Jane Wang

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Most publicly available datasets for image classification are with single labels, while images are inherently multilabeled in our daily life. Such an annotation gap makes many pretrained single-label classification models fail in practical scenarios. For aerial images, this annotation issue is more concerned: Aerial data naturally cover a relatively large land area with multiple labels, while annotated aerial datasets currently publicly available (e.g., UCM and AID) are single-labeled. As manually annotating multilabel aerial images (MAIs) would be time-/ labor-consuming, we propose a novel self-correction integrated domain adaptation (SCIDA) method for automatic multilabel learning. SCIDA is weakly supervised, i.e., automatically learning the multilabel image classification model from using massive, publicly available single-label images. To achieve this goal, we propose a novel labelwise self-correction (LWC) module to better explore underlying label correlations. This module also makes the unsupervised domain adaptation (UDA) from single-label to multilabel data possible. For model training, the proposed method uses single-label information yet requires no prior knowledge of multilabeled data and predicts labels for MAIs. Through extensive evaluations, the proposed model, which is trained with single-labeled MAI-AID-s and MAI-UCM-s datasets, achieves much better performances than comparative methods on our collected multiscene aerial image dataset. The code and data are available on GitHub (https://github.com/Ryan315/Single2multi-DA).

Original languageEnglish
Article number5803313
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume60
DOIs
StatePublished - 2022
Externally publishedYes

Keywords

  • Aerial image
  • MAI dataset
  • OpenStreetMap (OSM)
  • graph convolutional network (GCN)
  • noise
  • unsupervised domain adaptation (UDA)

Fingerprint

Dive into the research topics of 'SCIDA: Self-Correction Integrated Domain Adaptation from Single- to Multi-Label Aerial Images'. Together they form a unique fingerprint.

Cite this