HITL-AB-BPM: Business Process Improvement with AB Testing and Human-in-the-Loop

Aaron F. Kurz, Bennet Santelmann, Timo Großmann, Timotheus Kampik, Luise Pufahl, Ingo Weber

Research output: Contribution to journalConference articlepeer-review


Organizations improve their business processes regularly to react to clients’ requests, changing business environments, or regulations. However, applying a changed process design directly in an organization is risky: frequently, process changes do not result in actual improvements. In this demo, we present a tool for AB testing of process versions with reinforcement learning techniques and a new approach to human control of the procedure. The goal of the tool is a fair and fast comparison in the production environment. As the system might not have all information required to make informed decisions, we propose how human experts can be put in control.

Original languageEnglish
Pages (from-to)122-126
Number of pages5
JournalCEUR Workshop Proceedings
StatePublished - 2022
Externally publishedYes
Event2022 Best Dissertation Award, Doctoral Consortium, and Demonstration and Resources Track at BPM, BPM-D 2022 - Munster, Germany
Duration: 11 Sep 202216 Sep 2022


  • AB testing
  • Human-in-the-loop
  • Multi-armed bandit
  • Process redesign


Dive into the research topics of 'HITL-AB-BPM: Business Process Improvement with AB Testing and Human-in-the-Loop'. Together they form a unique fingerprint.

Cite this