Analysis of ChatGPT as a Question-Answering Tool
Pit Pichappan, M. Krishnamurthy, P. Vijayakumar
Journal of Digital Information Management, Vol. 21, No. 2, 2023.
DOI: https://doi.org/10.6025/jdim/2023/21/2/50-61
Link: https://www.dline.info/fpaper/jdim/v21i2/jdimv21i2_3.pdf
Abstract:
ChatGPT, in recent months, has made a significant impact and exposure in the information world. Many studies have been conducted within a shorter timeframe about its efficiency, reliability, ethics, accuracy and acceptance. Besides, hundreds of opinions and perception-based analyses have also emerged. In this work, we look at the ChatGPT as a question-answering tool. We have used randomly generated prompts to solicit answers and analysed the results from a text analysis angle. The answers are compared with text analysers both manually and statistically. ChatGPT still needs more precision for linguistic effects and fails to meet comprehensive users requirements.