Distinguishing Fact from Fiction: A Benchmark Dataset for Identifying Machine-Generated Scientific Papers in the LLM Era

Edoardo Mosca, Mohamed Hesham I. Abdalla, Paolo Basso, Margherita Musumeci, Georg Groh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

As generative NLP can now produce content nearly indistinguishable from human writing, it becomes difficult to identify genuine research contributions in academic writing and scientific publications. Moreover, information in NLP-generated text can potentially be factually wrong or even entirely fabricated. This study introduces a novel benchmark dataset, containing human-written and machine-generated scientific papers from SCIgen, GPT-2, GPT-3, ChatGPT, and Galactica. After describing the generation and extraction pipelines, we also experiment with four distinct classifiers as a baseline for detecting the authorship of scientific text. A strong focus is put on generalization capabilities and explainability to highlight the strengths and weaknesses of detectors. We believe our work serves as an important step towards creating more robust methods for distinguishing between human-written and machine-generated scientific papers, ultimately ensuring the integrity of scientific literature.

Original languageEnglish
Title of host publication3rd Workshop on Trustworthy Natural Language Processing, TrustNLP 2023 - Proceedings of the Workshop
EditorsAnaelia Ovalle, Kai-Wei Chang, Kai-Wei Chang, Ninareh Mehrabi, Yada Pruksachatkun, Aram Galystan, Aram Galystan, Jwala Dhamala, Apurv Verma, Trista Cao, Anoop Kumar, Rahul Gupta
PublisherAssociation for Computational Linguistics (ACL)
Pages190-207
Number of pages18
ISBN (Electronic)9781959429869
StatePublished - 2023
Event3rd Workshop on Trustworthy Natural Language Processing, TrustNLP 2023, co-located with ACL 2023 - Toronto, Canada
Duration: 14 Jul 2023 → …

Publication series

NameProceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)0736-587X

Conference

Conference3rd Workshop on Trustworthy Natural Language Processing, TrustNLP 2023, co-located with ACL 2023
Country/TerritoryCanada
CityToronto
Period14/07/23 → …

Fingerprint

Dive into the research topics of 'Distinguishing Fact from Fiction: A Benchmark Dataset for Identifying Machine-Generated Scientific Papers in the LLM Era'. Together they form a unique fingerprint.

Cite this