Graphics-based retrieval of color image databases using hand-drawn query sketches

Gerhard Rigoll, Stefan Müller

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


This paper presents a novel approach to graphics-based information retrieval validated with an experimental system that is able to perform integrated shape and color based image retrieval with hand-drawn sketches which can be presented in rotation-, scale-, and translation-invariant mode. Due to the use of Hidden Markov Models (HMMs), an elastic matching of shapes can be performed, which allows the retrieval of shapes by applying simple sketches. Since these sketches represent hand-made line drawings and can be augmented with color features, the resulting user query represents a complex graphics structure that has to be analyzed for retrieving the image database. The database elements (mostly images of hand tools) are represented by HMMs which have been modified in order to achieve the desired rotation invariance property. Invariance with respect to scaling and translation is achieved by the feature extraction, which is a polar sampling technique, with the center of the sampling raster positioned at the shapes‘s center of gravity. The outcome of the feature extraction step is also known as a shape matrix, which is a shape descriptor that has been already used occasionally in image processing tasks. The image retrieval system showed good retrieval results even with unexperienced users, which is demonstrated by a number of query sketches and corresponding retrieval images in this paper.

Original languageEnglish
Title of host publicationGraphics Recognition - Recent Advances - 3rd International Workshop, GREC 1999, Selected Papers
EditorsAtul K. Chhabra, Dov Dori
PublisherSpringer Verlag
Number of pages10
ISBN (Print)3540412220, 9783540412229
StatePublished - 2000
Externally publishedYes
Event3rd International Workshop on Graphics Recognition, GREC 1999 - Jaipur, India
Duration: 26 Sep 199927 Sep 1999

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference3rd International Workshop on Graphics Recognition, GREC 1999


Dive into the research topics of 'Graphics-based retrieval of color image databases using hand-drawn query sketches'. Together they form a unique fingerprint.

Cite this