500,000 Images Closer to Eyelid and Pupil Segmentation

Wolfgang Fuhl, Wolfgang Rosenstiel, Enkelejda Kasneci

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

16 Scopus citations

Abstract

Human gaze behavior is not the only important aspect about eye tracking. The eyelids reveal additional important information; such as fatigue as well as the pupil size holds indications of the workload. The current state-of-the-art datasets focus on challenges in pupil center detection, whereas other aspects, such as the lid closure and pupil size, are neglected. Therefore, we propose a fully convolutional neural network for pupil and eyelid segmentation as well as eyelid landmark and pupil ellipsis regression. The network is jointly trained using the Log loss for segmentation and L1 loss for landmark and ellipsis regression. The application of the proposed network is the offline processing and creation of datasets. Which can be used to train resource-saving and real-time machine learning algorithms such as random forests. In addition, we will provide the worlds largest eye images dataset with more than 500,000 images DOWNLOAD.

Original languageEnglish
Title of host publicationComputer Analysis of Images and Patterns - 18th International Conference, CAIP 2019, Proceedings
EditorsMario Vento, Gennaro Percannella
PublisherSpringer Verlag
Pages336-347
Number of pages12
ISBN (Print)9783030298876
DOIs
StatePublished - 2019
Externally publishedYes
Event18th International Conference on Computer Analysis of Images and Patterns, CAIP 2019 - Salerno, Italy
Duration: 3 Sep 20195 Sep 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11678 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th International Conference on Computer Analysis of Images and Patterns, CAIP 2019
Country/TerritoryItaly
CitySalerno
Period3/09/195/09/19

Keywords

  • Eye tracking
  • Eyelid opening
  • Eyelid regression
  • Eyelid segmentation
  • Landmark detection
  • Landmark regression
  • Pupil ellipses regression
  • Pupil segmentation

Fingerprint

Dive into the research topics of '500,000 Images Closer to Eyelid and Pupil Segmentation'. Together they form a unique fingerprint.

Cite this