Supporting, Contrasting, and Mentioning Citations in Computational Linguistics: Insights from Scite and Scopus

  • Sandra M K Department of Library and Information Science Tumkur University, Tumakuru- 572103
  • Rupesh Kumar A Department of Library and Information Science Tumkur University, Tumakuru- 572103

Abstract

Purpose: This study examines the contextual and sectional relevance of citations received by scholarly publications in computational linguistics using Scite. It further investigates the relationships between supporting, contrasting and mentioning citations and the corresponding Scopus citation counts. Methodology: Both conventional and contextual citation-analysis techniques were employed. Scientific publications on computational linguistics were retrieved from the Scopus database. Contextual citation data were subsequently obtained from the smart citation index Scite.ai, an emerging classified citation database built with machine learning, artificial intelligence and natural language processing. A total of 15,607 documents containing classified citation statements were included. Data were analysed in Microsoft Excel and statistical tests were performed with SPSS. Results: The analysis reveals a steady rise in both publications and citations. The 15,607 scholarly works collectively received 3,872 supporting, 375 contrasting and 343,855 mentioning citations corresponding to 1.09 % agreement, 0.11 % disagreement and 97.23 % neutral research engagement. Mentioning citations dominate every year, reflecting a tendency among scholars to cite neutrally without explicit endorsement or critique. Although contrasting citations are far fewer than supporting or mentioning citations, they remain significant because they signal critical scrutiny and inconsistencies in the published literature. Among the ten journals with the highest publication counts, Transactions of the Association for Computational Linguistics leads in both supporting and contrasting citations. Spearman’s rank-correlation tests show a strong positive association between mentioning citations and Scopus citations (? = .839, p = .000), a weak positive association with supporting citations ( ??= .336, ? = .000) and a still weaker positive association with contrasting citations (? = .153, p = .000). Sectional citation analysis indicates that the largest number of citations (6,031) fall into the “Other” category, underscoring the diversity of structural conventions in scientific communication. Conclusion: The investigation demonstrates the value of contextual citation analysis applied to computational linguistics research. The approach can be extended to author-, journal- and institutionallevel assessments to reveal genuine research impact. Contextual citation analysis offers a novel perspective that moves beyond the traditional assumption that “all that glitters is gold.”

References

[1] Alduais, A., Yassin, A. A., Allegretta, S. (2025). Computational linguistics: A scientometric review. Quality Quantity, 59(5), 4097–4136. https://doi.org/10.1007/s11135-025-02138-2.


[2] Bahadoran, Z., Mirmiran, P., Kashfi, K., Ghasemi, A. (2020). The Principles of Biomedical Scientific Writing: Citation. International Journal of Endocrinology and Metabolism, 18(2). https://doi.org/10.5812/ijem.102622.


[3] Bornmann, L., Daniel, H.-D. (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64(1), 45–80. https://doi.org/10.1108/00220410810844150.


[4] Bornmann, L., Wray, B. K., Haunschild, R. (2019). Citation concept analysis (CCA): A new form of citation analysis revealing the usefulness of concepts for other researchers illustrated by exemplary case studies including classic books by Thomas S. Kuhn and Karl R. Popper. Scientometrics, 122, 1051–1074. https:// doi.org/10.1007/s11192-019-03326-2.


[5] Coursera. (2025, March 11). What Is Computational Linguistics? Coursera. https://www.coursera.org/in/ articles/computational-linguistics.


[6] Dong, C., Schäfer, U. (2011). Ensemble-style Self-training on Citation Classification. In H. Wang D. Yarowsky (Eds.), Proceedings of 5th International Joint Conference on Natural Language Processing (p. 623–631). Asian Federation of Natural Language Processing. https://aclanthology.org/I11-1070.


[7] Hausser, R. (2014). Foundations of Computational Linguistics: Human-Computer Communication in Natural Language. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-41431-2.


[8] Hernández Alvarez, M., Gomez, J. M. (2016). Survey about citation context analysis: Tasks, techniques, and resources. Natural Language Engineering, 22(3), 327–349. https://doi.org/10.1017/S1351324915000388.


[9] Jangid, S., Rupak. (2025). AI-Powered Citation Classification: Understanding Contrasting and Supporting Citations in Scholarly Research. Annals of Library and Information Studies, 72(3). https://doi.org/10.56042/ alis.v72i3.19939.


[10] Kostoff, R. N. (1998). The use and misuse of citation analysis in research evaluation. Scientometrics, 43(1), 27–43. https://doi.org/10.1007/BF02458392.


[11] Nicholson, J. M., Mordaunt, M., Lopez, P., Uppala, A., Rosati, D., Rodrigues, N. P., Grabitz, P., Rife, S. C. (2021). scite: A smart citation index that displays the context of citations and classifies their intent using deep learning. Quantitative Science Studies, 2(3), 882–898. https://doi.org/10.1162/qss_a_00146.


[12] Radev, D. R., Joseph, M. T., Gibson, B., Muthukrishnan, P. (2016). A bibliometric and network analysis of the field of computational linguistics. Journal of the Association for Information Science and Technology, 67(3), 683–706. https://doi.org/10.1002/asi.23394.


[13] Sandra, M. K., Rupesh, K. (2024, January 10). (PDF) Citation Context Analysis: A Case Study of Scholarly Literature on Meniere’s Disease. LISACON 2024: 5th International Conference on Intelligent Libraries.


[14] Scite. (2024). Scite.ai. Scite.Ai. https://scite.ai.


[15] Wang, M., Ren, J., Li, S., Chen, G. (2019). Quantifying a Paper’s Academic Impact by Distinguishing the Unequal Intensities and Contributions of Citations. IEEE Access, 7, 96198–96214. https://doi.org/10.1109/ ACCESS.2019.2927016.


[16] Wang, M., Zhang, J., Jiao, S., Zhang, X., Zhu, N., Chen, G. (2020). Important citation identification by exploiting the syntactic and contextual information of citations. Scientometrics, 125(3), 2109–2129. https:/ /doi.org/10.1007/s11192-020-03677-1.


[17] Worrall, J. L., Cohn, E. G. (2023). Citation Data and Analysis: Limitations and Shortcomings. Journal of Contemporary Criminal Justice, 39(3), 327–340. https://doi.org/10.1177/10439862231170972.


[18] Yaseen, M. G., Alkattan, H., Farhan, L. (2025). The Evolution of Computational Linguistics: A Bibliometric Analysis of Research Trends from 1966 to 2023. Applied Data Science and Analysis, 2025, 83–93. [19] Zunde, P. (1971). Structural models of complex information sources. Information Storage and Retrieval, 7(1), 1–18. https://doi.org/10.1016/0020-0271(71)90023-4.

Published
2026-10-30
How to Cite
M K, Sandra; KUMAR A, Rupesh. Supporting, Contrasting, and Mentioning Citations in Computational Linguistics: Insights from Scite and Scopus. Journal of Science & Technology Metrics, Vol. 17(3), p. 150-160, oct. 2026. ISSN 2582-6956. Available at: <https://www.dline.info/ojs/index.php/jstm/article/view/608>. Date accessed: 16 nov. 2026.