Fourth Fifth International Conference on Science and Technology Metrics (STMet 2024)
 

 

Altmetrics indicators for institutional performance assessment: Does a relationship with traditional indicators exist?
Solanki Gupta, Abhirup Nandy, Hiran H. Lathabai, Nilabhra Rohan Das, Vivek Kumar Singh
Department of Computer Science, Banaras Hindu University, Varanasi, India ., School of Engineering and Technology, KR Mangalam University, Gurugram-122103, India ., Amrita CREATE, Amrita Vishwa Vidyapeetham, Amritapuri-690525, Kerala, India ., Bristol Med
Abstract: Scientometricians are exploring altmetrics in different contexts. Its potential as an early impact assessment tool and possible predictor of future impact is one of the most widely explored themes in altmetric research. Many studies explored the relationship between altmetrics and traditional indicators. But relationships at the level of actors of science and technology, like individual scholars, institutions, etc., remain underexplored. In this work, we attempt to study the relationship at the institutional level using the top 135 productive Indian institutions. Explorations carried out include both raw as well as derived indicators. Mendeley reads is found to be the most promising raw altmetric indicator. It is also determined as the suitable source to derive many derived indicators. The potential of recently introduced indicators like , x and xd to be used for creating derived altmetric indicators is also revealed. Avenues for further research that may strengthen the usefulness of altmetrics are also discussed.
Keywords: Performance Assessment, Bibliometric Indicators, Altmetric Indicators Altmetrics indicators for institutional performance assessment: Does a relationship with traditional indicators exist?
DOI:https://doi.org/10.6025/stm/2024/5/198-203
Full_Text   PDF    Download:   43  times
References:


[1] Bornmann, L. (2014b). Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics, 8(4), 895-903.
[2] Tahamtan, I., & Bornmann, L. (2020). Altmetrics and societal impact measurements: Match or mismatch? A literature review. El profesional de la información (EPI), 29(1).

[3] Thelwall, M. (2021). Measuring societal impacts of research with altmetrics? Common problems and mistakes. Journal of Economic Surveys, 35(5), 1302-1314.
[4] Garcovich, D., & Adobes Martin, M. (2020). Measuring the social impact of research in Paediatric Dentistry: An Altmetric study. International Journal of Paediatric Dentistry, 30(1), 66-74.
[5] Haustein, S., Peters, I., Bar-ilan, J., Priem, J., Shema, H., Jens, T., & Terliesner, J. (2014a). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 101(2), 1145–1163. https://doi.org/10.1007/s11192-013-1221-3
[6] Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Larivière, V. (2014b). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, 65(4), 656-669.
[7] Lin, J. (2012, June). A case study in anti-gaming mechanisms for altmetrics: PLOS ALMs and DataTrust. In paper, altmetrics12 ACM Web Science Conference, Evanston, IL.
[8] Thelwall, M., Kousha, K., Dinsmore, A., & Dolby, K. (2015). Alternative metric indicators for funding scheme evaluations. Aslib Journal of Information Management, 68(1), 2–18.
[9] Alotaibi, N. M., Guha, D., Fallah, A., Aldakkan, A., Nassiri, F., Badhiwala, J. H., ... & Lozano, A. M. (2016). Social media metrics and bibliometric profiles of neurosurgical departments and journals: is there a relationship? World neurosurgery, 90, 574-579.
[10] Mueller, A. M., Wood Matabele, K. L., Edalatpour, A., Marks, J. M., & Afifi, A. M. (2023). Social Media Popularity and Academic Productivity in Academic Plastic Surgery: A Positive Correlation. Aesthetic Plastic Surgery, 1-9.
[11] Ortega, J. L. (2015). Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC’s members. Journal of informetrics, 9(1), 39-49.
[12] Oliveira J e Silva, L., Maldonado, G., Brigham, T., Mullan, A. F., Utengen, A., & Cabrera, D. (2021). Evaluating scholars’ impact and influence: Cross-sectional study of the correlation between a novel social media–based score and an author-level citation metric. Journal of Medical Internet Research, 23(5), e28859.
[13] Zhang, D., & Earp, B. E. (2020). Correlation between social media posts and academic citations of orthopaedic research. JAAOS Global Research & Reviews, 4(9).
[14] Biranvand, A., & Cheraghi, Z. (2022). Investigating the Relationship between Altmetrics indicators and Scientometric indicators of Iranian researchers in the field of nursing in the period 2000-2019. International Journal of Information Science and Management (IJISM), 20(3), 215-225.
[15] Mohammadi, E., & Thelwall, M. (2014). Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows. Journal of the Association for Information Science and Technology, 65(8), 1627-1638.
[16] Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2011). Altmetrics: A manifesto. http://altmetrics.org/manifesto/
[17] Priem, J., & Hemminger, B. H. (2010). Scientometrics 2.0: New metrics of scholarly impact on the social Web. First monday.
[18] Piwowar, H., & Priem, J. (2013). The power of altmetrics on a CV. Bulletin of the American Society for Information Science and Technology, 39(4), 10-13.
[19] Shema, H., Bar Ilan, J., & Thelwall, M. (2014). Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics. Journal of the Association for information science and technology, 65(5), 1018-1027.
[20] Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National academy of Sciences, 102(46), 16569-16572.
[21] Egghe, L. (2006). Theory and practise of the g-index. Scientometrics, 69(1), 131-152.
[22] Lathabai, H. H. (2020). ø-index: A new overall productivity index for actors of science and technology. Journal of Informetrics, 14(4), 101096.
[23] Lathabai, H. H., Nandy, A., & Singh, V. K. (2021). x-index: Identifying core competency and thematic research strengths of institutions using an NLP and network based ranking framework. Scientometrics, 126(12), 9557-9583.
[24] Nandy, A., Lathabai, H. H., & Singh, V. K. (2023). x_d-index: An overall scholarly expertise index for the research portfolio management of institutions. Proceedings of 19th International Conference of Scientometrics and Informetrics (ISSI). 473- 448. 10.5281/zenodo.8305585.
[25] Lathabai, H. H., & Prabhakaran, T. (2023). Contextual Ø-index and its estimate for contextual productivity assessment. Scientometrics, 128(8), 4875-4886.
[26] Thelwall, M. (2017). Are Mendeley reader counts useful impact indicators in all fields? Scientometrics, 113(3), 1721-1731.
[27] Thelwall, M. (2018). Early Mendeley readers correlate with later citation counts. Scientometrics, 115(3), 1231-1240.

Copyright © 2023 dline.info