Semantic Segmentation and Inpainting of Dust with the S-Dust Dataset

Peter Buckel, Timo Oksanen, Thomas Dietmueller

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In agriculture the performance of camera-based vision systems is strongly affected by environmental factors, such as rain, fog, and dust. This paper presents the first open dataset for training and evaluating image processing algorithms that remove swirling dust from images. It includes images from agricultural fields during tillage, which raises dust that is manually labeled in the images. However, dust is not a classical object that can be delineated based on edges. Moreover, the dust density is not uniformly distributed but varies and is concentrated in the area behind the implement. Therefore, different segmentation approaches were investigated. First, traditional and deep-learning methods for dust segmentation in images were compared. For the neural network, a Unet with a pretrained VGG encoder was chosen. The results show that the network cannot distinguish from the background in areas with low dust density. In contrast, the traditional segmentation method based on dark channel prior (DCP) outperforms it. Subsequently, various inpainting methods to remove dust were investigated. One observation was that dust removal from images cannot be solved with current inpainting methods.

Original languageEnglish
Title of host publicationIFAC-PapersOnLine
EditorsHideaki Ishii, Yoshio Ebihara, Jun-ichi Imura, Masaki Yamakita
PublisherElsevier B.V.
Pages8896-8901
Number of pages6
Edition2
ISBN (Electronic)9781713872344
DOIs
StatePublished - 1 Jul 2023
Externally publishedYes
Event22nd IFAC World Congress - Yokohama, Japan
Duration: 9 Jul 202314 Jul 2023

Publication series

NameIFAC-PapersOnLine
Number2
Volume56
ISSN (Electronic)2405-8963

Conference

Conference22nd IFAC World Congress
Country/TerritoryJapan
CityYokohama
Period9/07/2314/07/23

Keywords

  • Pattern recognition and artificial intelligence in agriculture
  • agricultural dust
  • image analysis
  • image inpainting

Fingerprint

Dive into the research topics of 'Semantic Segmentation and Inpainting of Dust with the S-Dust Dataset'. Together they form a unique fingerprint.

Cite this