Diba: A Re-Configurable Stream Processor

Mohammadreza Najafi, Thamir M. Qadah, Mohammad Sadoghi, Hans Arno Jacobsen

Research output: Contribution to journalArticlepeer-review


Stream processing acceleration is driven by the continuously increasing volume and velocity of data generated on the Web and the limitations of storage, computation, and power consumption. Hardware solutions provide better performance and power consumption, but they are hindered by the high research and development costs and the long time to market. In this work, we propose our re-configurable stream processor (Diba), a complete rethinking of a previously proposed customized and flexible query processor that targets real-time stream processing. Diba uses a unidirectional dataflow not dedicated to any specific type of query (operator) on streams, allowing a straightforward placement of processing components on a general data path that facilitates query mapping. In Diba, the concepts of the distribution network and processing components are implemented as two separate entities connected using generic interfaces. This approach allows the adoption of a versatile architecture for a family of queries rather than forcing a rigid chain of processing components to implement such queries. Our experimental evaluations of representative queries from TPC-H yielded processing times of 300, 1220, and 3520 milliseconds for data streams with scale factor sizes of one, four, and ten gigabytes, respectively.

Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Knowledge and Data Engineering
StateAccepted/In press - 2024
Externally publishedYes


  • Computer architecture
  • Dataflow architecture
  • Engines
  • Field programmable gate arrays
  • Hardware acceleration
  • Libraries
  • Pipelines
  • Query processing
  • hardware architecture
  • multiple data stream architecture


Dive into the research topics of 'Diba: A Re-Configurable Stream Processor'. Together they form a unique fingerprint.

Cite this