TY - JOUR
T1 - Can ChatGPT's Responses Boost Traditional Natural Language Processing?
AU - Amin, Mostafa M.
AU - Cambria, Erik
AU - Schuller, Bjorn W.
N1 - Publisher Copyright:
© 2001-2011 IEEE.
PY - 2023/9/1
Y1 - 2023/9/1
N2 - The employment of foundation models is steadily expanding, especially with the launch of ChatGPT and the release of other foundation models. These models have shown the potential of emerging capabilities to solve problems without being particularly trained to solve them. A previous work demonstrated these emerging capabilities in affective computing tasks; the performance quality was similar to that of traditional natural language processing (NLP) techniques but fell short of specialized trained models, like fine-tuning of the RoBERTa language model. In this work, we extend this by exploring whether ChatGPT has novel knowledge that would enhance existing specialized models when they are fused together. We achieve this by investigating the utility of verbose responses from ChatGPT for solving a downstream task in addition to studying the utility of fusing that with existing NLP methods. The study is conducted on three affective computing problems: namely, sentiment analysis, suicide tendency detection, and big-five personality assessment. The results conclude that ChatGPT has, indeed, novel knowledge that can improve existing NLP techniques by way of fusion, be it early or late fusion.
AB - The employment of foundation models is steadily expanding, especially with the launch of ChatGPT and the release of other foundation models. These models have shown the potential of emerging capabilities to solve problems without being particularly trained to solve them. A previous work demonstrated these emerging capabilities in affective computing tasks; the performance quality was similar to that of traditional natural language processing (NLP) techniques but fell short of specialized trained models, like fine-tuning of the RoBERTa language model. In this work, we extend this by exploring whether ChatGPT has novel knowledge that would enhance existing specialized models when they are fused together. We achieve this by investigating the utility of verbose responses from ChatGPT for solving a downstream task in addition to studying the utility of fusing that with existing NLP methods. The study is conducted on three affective computing problems: namely, sentiment analysis, suicide tendency detection, and big-five personality assessment. The results conclude that ChatGPT has, indeed, novel knowledge that can improve existing NLP techniques by way of fusion, be it early or late fusion.
UR - http://www.scopus.com/inward/record.url?scp=85171584641&partnerID=8YFLogxK
U2 - 10.1109/MIS.2023.3305861
DO - 10.1109/MIS.2023.3305861
M3 - Article
AN - SCOPUS:85171584641
SN - 1541-1672
VL - 38
SP - 5
EP - 11
JO - IEEE Intelligent Systems
JF - IEEE Intelligent Systems
IS - 5
ER -