Workshops as a research method: Guidelines for designing and evaluating artifacts through workshops

Katja Thoring, Roland M. Mueller, Petra Badke-Schaub

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

30 Scopus citations

Abstract

Workshops are often used in the information systems (IS) and design fields to evaluate artifacts or to co-create business innovations. However, the evaluation of workshops is often conducted in a rather unsystematic and heterogenous way. This paper introduces a set of guidelines for designing or evaluating artifacts through workshops. These guidelines include five evaluation principles and a framework that outlines appropriate evaluation methods for different research goals. The relevant constructs and principles were identified based on related literature. The derived evaluation matrix was then revised based on ratings of five experts who independently assigned appropriate research methods for different evaluation foci. The framework's applicability was evaluated by comparing it with ten papers from the IS and design fields. The proposed guidelines can support researchers with conducting workshop evaluations in a comparable and replicable way, which will help to improve research rigor in the future.

Original languageEnglish
Title of host publicationProceedings of the 53rd Annual Hawaii International Conference on System Sciences, HICSS 2020
EditorsTung X. Bui
PublisherIEEE Computer Society
Pages5036-5045
Number of pages10
ISBN (Electronic)9780998133133
StatePublished - 2020
Externally publishedYes
Event53rd Annual Hawaii International Conference on System Sciences, HICSS 2020 - Maui, United States
Duration: 7 Jan 202010 Jan 2020

Publication series

NameProceedings of the Annual Hawaii International Conference on System Sciences
Volume2020-January
ISSN (Print)1530-1605

Conference

Conference53rd Annual Hawaii International Conference on System Sciences, HICSS 2020
Country/TerritoryUnited States
CityMaui
Period7/01/2010/01/20

Fingerprint

Dive into the research topics of 'Workshops as a research method: Guidelines for designing and evaluating artifacts through workshops'. Together they form a unique fingerprint.

Cite this