A bigbench implementation in the hadoop ecosystem

Badrul Chowdhury; Tilmann Rabl; Pooya Saadatpanah; Jiang Du; Hans Arno Jacobsen

doi:10.1007/978-3-319-10596-3_1

A bigbench implementation in the hadoop ecosystem

Badrul Chowdhury, Tilmann Rabl, Pooya Saadatpanah, Jiang Du, Hans Arno Jacobsen

University of Toronto

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

12 Scopus citations

Abstract

BigBench is the first proposal for an end to end big data analytics benchmark. It features a rich query set with complex, realistic queries. BigBench was developed based on the decision support benchmark TPC-DS. The first proof-of-concept implementation was built for the Teradata Aster parallel database system and the queries were formulated in the proprietary SQL-MR query language. To test other systems, the queries have to be translated.

In this paper, an alternative implementation of BigBench for the Hadoop ecosystem is presented. All 30 queries of BigBench were realized using Apache Hive, Apache Hadoop, Apache Mahout, and NLTK. We will present the different design choices we took and show a proof of concept evaluation.

Original language	English
Title of host publication	Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers
Editors	Meikel Poess, Tilmann Rabl, Hans-Arno Jacobsen, Chaitanya Baru, Nambiar Raghunath, Milind Bhandarkar
Publisher	Springer Verlag
Pages	3-18
Number of pages	16
ISBN (Electronic)	9783319105956
DOIs	https://doi.org/10.1007/978-3-319-10596-3_1
State	Published - 2014
Externally published	Yes
Event	2013 Workshop Series on Big Data Benchmarking, WBDB.cn and WBDB.us. - Boston, United States Duration: 14 Sep 2014 → 18 Sep 2014

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	8585
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	2013 Workshop Series on Big Data Benchmarking, WBDB.cn and WBDB.us.
Country/Territory	United States
City	Boston
Period	14/09/14 → 18/09/14

Access to Document

10.1007/978-3-319-10596-3_1

Cite this

Chowdhury, B., Rabl, T., Saadatpanah, P., Du, J., & Jacobsen, H. A. (2014). A bigbench implementation in the hadoop ecosystem. In M. Poess, T. Rabl, H.-A. Jacobsen, C. Baru, N. Raghunath, & M. Bhandarkar (Eds.), Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers (pp. 3-18). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8585). Springer Verlag. https://doi.org/10.1007/978-3-319-10596-3_1

Chowdhury, Badrul ; Rabl, Tilmann ; Saadatpanah, Pooya et al. / A bigbench implementation in the hadoop ecosystem. Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers. editor / Meikel Poess ; Tilmann Rabl ; Hans-Arno Jacobsen ; Chaitanya Baru ; Nambiar Raghunath ; Milind Bhandarkar. Springer Verlag, 2014. pp. 3-18 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{23597602bccd4ac0bfcc2cec20821392,

title = "A bigbench implementation in the hadoop ecosystem",

abstract = "BigBench is the first proposal for an end to end big data analytics benchmark. It features a rich query set with complex, realistic queries. BigBench was developed based on the decision support benchmark TPC-DS. The first proof-of-concept implementation was built for the Teradata Aster parallel database system and the queries were formulated in the proprietary SQL-MR query language. To test other systems, the queries have to be translated.In this paper, an alternative implementation of BigBench for the Hadoop ecosystem is presented. All 30 queries of BigBench were realized using Apache Hive, Apache Hadoop, Apache Mahout, and NLTK. We will present the different design choices we took and show a proof of concept evaluation.",

author = "Badrul Chowdhury and Tilmann Rabl and Pooya Saadatpanah and Jiang Du and Jacobsen, {Hans Arno}",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2014.; 2013 Workshop Series on Big Data Benchmarking, WBDB.cn and WBDB.us. ; Conference date: 14-09-2014 Through 18-09-2014",

year = "2014",

doi = "10.1007/978-3-319-10596-3_1",

language = "English",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "3--18",

editor = "Meikel Poess and Tilmann Rabl and Hans-Arno Jacobsen and Chaitanya Baru and Nambiar Raghunath and Milind Bhandarkar",

booktitle = "Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers",

}

Chowdhury, B, Rabl, T, Saadatpanah, P, Du, J & Jacobsen, HA 2014, A bigbench implementation in the hadoop ecosystem. in M Poess, T Rabl, H-A Jacobsen, C Baru, N Raghunath & M Bhandarkar (eds), Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8585, Springer Verlag, pp. 3-18, 2013 Workshop Series on Big Data Benchmarking, WBDB.cn and WBDB.us., Boston, United States, 14/09/14. https://doi.org/10.1007/978-3-319-10596-3_1

A bigbench implementation in the hadoop ecosystem. / Chowdhury, Badrul; Rabl, Tilmann; Saadatpanah, Pooya et al.
Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers. ed. / Meikel Poess; Tilmann Rabl; Hans-Arno Jacobsen; Chaitanya Baru; Nambiar Raghunath; Milind Bhandarkar. Springer Verlag, 2014. p. 3-18 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8585).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A bigbench implementation in the hadoop ecosystem

AU - Chowdhury, Badrul

AU - Rabl, Tilmann

AU - Saadatpanah, Pooya

AU - Du, Jiang

AU - Jacobsen, Hans Arno

N1 - Publisher Copyright: © Springer International Publishing Switzerland 2014.

PY - 2014

Y1 - 2014

N2 - BigBench is the first proposal for an end to end big data analytics benchmark. It features a rich query set with complex, realistic queries. BigBench was developed based on the decision support benchmark TPC-DS. The first proof-of-concept implementation was built for the Teradata Aster parallel database system and the queries were formulated in the proprietary SQL-MR query language. To test other systems, the queries have to be translated.In this paper, an alternative implementation of BigBench for the Hadoop ecosystem is presented. All 30 queries of BigBench were realized using Apache Hive, Apache Hadoop, Apache Mahout, and NLTK. We will present the different design choices we took and show a proof of concept evaluation.

AB - BigBench is the first proposal for an end to end big data analytics benchmark. It features a rich query set with complex, realistic queries. BigBench was developed based on the decision support benchmark TPC-DS. The first proof-of-concept implementation was built for the Teradata Aster parallel database system and the queries were formulated in the proprietary SQL-MR query language. To test other systems, the queries have to be translated.In this paper, an alternative implementation of BigBench for the Hadoop ecosystem is presented. All 30 queries of BigBench were realized using Apache Hive, Apache Hadoop, Apache Mahout, and NLTK. We will present the different design choices we took and show a proof of concept evaluation.

UR - http://www.scopus.com/inward/record.url?scp=84910092192&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-10596-3_1

DO - 10.1007/978-3-319-10596-3_1

M3 - Conference contribution

AN - SCOPUS:84910092192

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 3

EP - 18

BT - Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers

A2 - Poess, Meikel

A2 - Rabl, Tilmann

A2 - Jacobsen, Hans-Arno

A2 - Baru, Chaitanya

A2 - Raghunath, Nambiar

A2 - Bhandarkar, Milind

PB - Springer Verlag

T2 - 2013 Workshop Series on Big Data Benchmarking, WBDB.cn and WBDB.us.

Y2 - 14 September 2014 through 18 September 2014

ER -

Chowdhury B, Rabl T, Saadatpanah P, Du J, Jacobsen HA. A bigbench implementation in the hadoop ecosystem. In Poess M, Rabl T, Jacobsen HA, Baru C, Raghunath N, Bhandarkar M, editors, Advancing Big Data Benchmarks - Proceedings of the 2013 Workshop Series on Big Data Benchmarking WBDB.cn and WBDB.us, Revised Selected Papers. Springer Verlag. 2014. p. 3-18. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-10596-3_1

A bigbench implementation in the hadoop ecosystem

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this