Towards an ecosystem for reproducible research in computer networking

Quirin Scheitle; Matthias Wählisch; Oliver Gasser; Thomas C. Schmidt; Georg Carle

doi:10.1145/3097766.3097768

Towards an ecosystem for reproducible research in computer networking

Quirin Scheitle, Matthias Wählisch, Oliver Gasser, Thomas C. Schmidt, Georg Carle

Informatics 8 - Chair of Network Architectures and Services

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

46 Scopus citations

Abstract

Reproducibility is key to rigorous scientific progress. However, many publications in the computer networks community lack support for reproducibility. In this paper, we argue that the lack is mainly rooted in the additional effort that authors need to spend, without expecting sufficient benefits. Based on our experience in both authoring reproducible research and reproducing publications, we propose an ecosystem that incentivizes authors and reproducers to invest additional effort. This ecosystem consists of various building blocks, which can be combined into venue-specific profiles. A key building block is the Reproducibility Challenge, which we suggest to co-locate with the annual SIGCOMM conference to leverage reproducibility research in practice.

Original language	English
Title of host publication	Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017
Publisher	Association for Computing Machinery, Inc
Pages	5-8
Number of pages	4
ISBN (Electronic)	9781450350600
DOIs	https://doi.org/10.1145/3097766.3097768
State	Published - 11 Aug 2017
Event	2017 ACM SIGCOMM Reproducibility Workshop, Reproducibility 2017 - Los Angeles, United States Duration: 25 Aug 2017 → …

Publication series

Name	Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017

Conference

Conference	2017 ACM SIGCOMM Reproducibility Workshop, Reproducibility 2017
Country/Territory	United States
City	Los Angeles
Period	25/08/17 → …

Keywords

Networks
Reproducibility
Reproducibility challenge

Access to Document

10.1145/3097766.3097768

Cite this

Scheitle, Q., Wählisch, M., Gasser, O., Schmidt, T. C., & Carle, G. (2017). Towards an ecosystem for reproducible research in computer networking. In Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017 (pp. 5-8). (Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017). Association for Computing Machinery, Inc. https://doi.org/10.1145/3097766.3097768

Scheitle, Quirin ; Wählisch, Matthias ; Gasser, Oliver et al. / Towards an ecosystem for reproducible research in computer networking. Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017. Association for Computing Machinery, Inc, 2017. pp. 5-8 (Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017).

@inproceedings{b22a79d79a874c3faf565647f9845b98,

title = "Towards an ecosystem for reproducible research in computer networking",

abstract = "Reproducibility is key to rigorous scientific progress. However, many publications in the computer networks community lack support for reproducibility. In this paper, we argue that the lack is mainly rooted in the additional effort that authors need to spend, without expecting sufficient benefits. Based on our experience in both authoring reproducible research and reproducing publications, we propose an ecosystem that incentivizes authors and reproducers to invest additional effort. This ecosystem consists of various building blocks, which can be combined into venue-specific profiles. A key building block is the Reproducibility Challenge, which we suggest to co-locate with the annual SIGCOMM conference to leverage reproducibility research in practice.",

keywords = "Networks, Reproducibility, Reproducibility challenge",

author = "Quirin Scheitle and Matthias W{\"a}hlisch and Oliver Gasser and Schmidt, {Thomas C.} and Georg Carle",

note = "Publisher Copyright: {\textcopyright} 2017 Association for Computing Machinery.; 2017 ACM SIGCOMM Reproducibility Workshop, Reproducibility 2017 ; Conference date: 25-08-2017",

year = "2017",

month = aug,

day = "11",

doi = "10.1145/3097766.3097768",

language = "English",

series = "Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017",

publisher = "Association for Computing Machinery, Inc",

pages = "5--8",

booktitle = "Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017",

}

Scheitle, Q, Wählisch, M, Gasser, O, Schmidt, TC & Carle, G 2017, Towards an ecosystem for reproducible research in computer networking. in Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017. Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017, Association for Computing Machinery, Inc, pp. 5-8, 2017 ACM SIGCOMM Reproducibility Workshop, Reproducibility 2017, Los Angeles, United States, 25/08/17. https://doi.org/10.1145/3097766.3097768

Towards an ecosystem for reproducible research in computer networking. / Scheitle, Quirin; Wählisch, Matthias; Gasser, Oliver et al.
Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017. Association for Computing Machinery, Inc, 2017. p. 5-8 (Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Towards an ecosystem for reproducible research in computer networking

AU - Scheitle, Quirin

AU - Wählisch, Matthias

AU - Gasser, Oliver

AU - Schmidt, Thomas C.

AU - Carle, Georg

PY - 2017/8/11

Y1 - 2017/8/11

N2 - Reproducibility is key to rigorous scientific progress. However, many publications in the computer networks community lack support for reproducibility. In this paper, we argue that the lack is mainly rooted in the additional effort that authors need to spend, without expecting sufficient benefits. Based on our experience in both authoring reproducible research and reproducing publications, we propose an ecosystem that incentivizes authors and reproducers to invest additional effort. This ecosystem consists of various building blocks, which can be combined into venue-specific profiles. A key building block is the Reproducibility Challenge, which we suggest to co-locate with the annual SIGCOMM conference to leverage reproducibility research in practice.

AB - Reproducibility is key to rigorous scientific progress. However, many publications in the computer networks community lack support for reproducibility. In this paper, we argue that the lack is mainly rooted in the additional effort that authors need to spend, without expecting sufficient benefits. Based on our experience in both authoring reproducible research and reproducing publications, we propose an ecosystem that incentivizes authors and reproducers to invest additional effort. This ecosystem consists of various building blocks, which can be combined into venue-specific profiles. A key building block is the Reproducibility Challenge, which we suggest to co-locate with the annual SIGCOMM conference to leverage reproducibility research in practice.

KW - Networks

KW - Reproducibility

KW - Reproducibility challenge

UR - http://www.scopus.com/inward/record.url?scp=85030165483&partnerID=8YFLogxK

U2 - 10.1145/3097766.3097768

DO - 10.1145/3097766.3097768

M3 - Conference contribution

AN - SCOPUS:85030165483

T3 - Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017

SP - 5

EP - 8

BT - Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017

PB - Association for Computing Machinery, Inc

T2 - 2017 ACM SIGCOMM Reproducibility Workshop, Reproducibility 2017

Y2 - 25 August 2017

ER -

Scheitle Q, Wählisch M, Gasser O, Schmidt TC, Carle G. Towards an ecosystem for reproducible research in computer networking. In Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017. Association for Computing Machinery, Inc. 2017. p. 5-8. (Reproducibility 2017 - Proceedings of the Reproducibility Workshop, Part of SIGCOMM 2017). doi: 10.1145/3097766.3097768

Towards an ecosystem for reproducible research in computer networking

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this