International Journal of Information Science and Management (IJISM)

Examining the Association between Citations and Altmetric Indicators of LIS Articles indexed in Dimensions Database

Document Type : Articles

Authors

Vysakh Chingath
Rajendra Babu Hanumanthappa

Tumkur University

https://doi.org/10.22034/ijism.2023.1977881.0
Abstract
Social media attention to scholarly articles has become a novel measure for assessing the broader impact of research, which complements the traditional citation metrics. This article examined the correlation between citations with major altmetric indicators for 1951 LIS articles published in 2020. Altmetric Explorer was used for collecting the data, and analysis was done using Excel and SPSS. The result showed that LIS articles were well engaged on social media platforms gaining more societal attention than their scientific reference in terms of citations. Mendeley (69.40%) and Twitter (28.72%) were the top intakes of LIS articles, and Pinterest (0.001%) and F1000 (0.001%) were the least ones. The users from the USA were the major Twitterati for the LIS articles, with average Tweeters of -0.58 across the globe. The users from the UK were the top mentioner of the articles on Facebook (2.7%), while the USA was on the News and mainstream media (55.6%). Except for Peer review (r= -0.05), all other altimetric indicators were positively associated with Dimensions citations. The study's findings allow the authors to analyze the societal impact of their scholarship through altmetric indicators and use altmetric indicators as supplementary to the citation metrics for measuring the immediate impact of the LIS scientific outputs.

Keywords

Library and Information Science
Traditional metrics
Altmetrics
Correlation
  1. Abbasi, S. (2018). Tracing the Visibility of Swedish LIS Research Articles by Using Altmetrics. University of Boras. Retrieved from http://hb.diva-portal.org/smash/record.jsf?pid=diva2%3A1305290&dswid=-1835
  2. Ali, M. Y. & Richardson, J. (2017). Pakistani LIS scholars' altmetrics in ResearchGate. Program, 51(2), 152-169. https://doi.org/10.1108/PROG-07-2016-0052
  3. com. (2021). Facebook Tracking. Retrieved from https://help.altmetric.com/support/solutions/articles/6000235936-facebook
  4. Banshal, S. K., Singh, V. K., Muhuri, P. K. & Mayr, P. (2019). How much research output from India gets social media attention ? Current Science, 117(5), 753-760. https://doi.org/10.18520/cs/v117/i5/753-760 760
  5. Barnes, C. (2015). The Use of Altmetrics as a Tool for Measuring Research Impact. Australian Academic & Research Libraries, 46(2), 121-134. https://doi.org/10.1080/00048623.2014.1003174
  6. Biranvand, A. & Cheraghi, Z. (2022). Investigating the relationship between altmetrics indicators and scientometric indicators of Iranian researchers in the field of nursing in the period 2000-2019. International Journal of Information Science and Management, 20(3), 215-225. https://dorl.net/dor/20.1001.1.20088302.2022.20.3.12.9
  7. Chang, J., Desai, N. & Gosain, A. (2019). Correlation Between Altmetric Score and Citations in Pediatric Surgery Core Journals. Journal of Surgical Research, 243, 52-58. https://doi.org/10.1016/j.jss.2019.05.010
  8. Chen, K., Tang, M., Wang, C. & Hsiang, J. (2015). Exploring alternative metrics of scholarly performance in the social sciences and humanities in Taiwan. Scientometrics, 1, 97-112. https://doi.org/10.1007/s11192-014-1420-6
  9. Chi, A. J., Lopes, A. J., Rong, L. Q., Charlson, M. E., Alvarez, R. D. & Boerner, T. (2021). Examining the correlation between Altmetric Attention Score and citation count in the gynecologic oncology literature: Does it have an impact? Gynecologic Oncology Reports, 37, 100778. https://doi.org/10.1016/j.gore.2021.100778
  10. Cho, J. (2021). Altmetrics analysis of highly cited academic papers in the field of library and information science. Scientometrics, 126(9), 7623-7635. https://doi.org/10.1007/s11192-021-04084-w
  11. Dancey, C. & Reidy, J. (2011). Statistics without maths for psychology. Pearson education.
  12. De Winter, J. C. F. (2015). The relationship between tweets, citations, and article views for PLOS ONE articles. Scientometrics, 102(2), 1773-1779. https://doi.org/10.1007/s11192-014-1445-x
  13. Ezema, I. J. & Ugwu, C. I. (2019). Correlating research impact of library and information science journals using citation counts and altmetrics attention. Information Discovery and Delivery, 47(3), 143–153. https://doi.org/10.1108/IDD-08-2018-0029
  14. Ferreira, M. R., Mongeon, P. & Costas, R. (2021). Large-Scale Comparison of Authorship, Citations, and Tweets of Web of Science Authors. Journal of Altmetrics, 4(1). https://doi.org/10.29024/joa.38
  15. Ghazi Mirsaeid, S. J., Amini, S. & Karimi Azar, Z. (2022). Altmetrics and Citation-Based Indicators in Dentistry Articles of Tehran and Shahid Beheshti Universities of Medical Sciences during 2014-2019. International Journal of Information Science and Management (IJISM), 20(2), 167-180. https://dorl.net/dor/20.1001.1.20088302.2022.20.2.10.5
  16. Grosh, T., Kim, J., Graff, V., Mariano, E. R., & Elkassabany, N. M. (2022). Is there a correlation between Altmetric Attention Scores and citation count in Regional Anesthesia and Pain Medicine journal articles? Regional Anesthesia & Pain Medicine, 47(10), 649-650. https://doi.org/10.1136/rapm-2022-103554
  17. Hammarfelt, B. (2014). Using altmetrics for assessing research impact in the humanities. Scientometrics, 101(2), 1419-1430. https://doi.org/10.1007/s11192-014-1261-3
  18. Htoo, T. H. H. & Na, J. C. (2017). Disciplinary differences in altmetrics for social sciences. Online Information Review, 41(2), 235-251. https://doi.org/10.1108/OIR-12-2015-0386
  19. Liu, C. & Huang, M. H. (2022). Exploring the relationships between altmetric counts and citations of papers in different academic fields based on co-occurrence analysis. Scientometrics, 127(8), 4939-4958. https://doi.org/10.1007/s11192-022-04456-w
  20. Maflah, N. & Thelwall, M. (2014). When are readership counts as useful as citation counts? Scopus versus Mendeley for LIS journals. Journal of the Association for Information Science and Technology. https://doi.org/10.1002/asi
  21. McGillivray, B. & Astell, M. (2019). The relationship between usage and citations in an open access mega-journal. Scientometrics, 121(2), 817–838. https://doi.org/10.1007/s11192-019-03228-3
  22. Mohammadi, E. & Thelwall, M. (2013). Assessing non-standard article impact using F1000 labels. Scientometrics, 97(2), 383-395. https://doi.org/10.1007/s11192-013-0993-9
  23. Mohammadi, E. & Thelwall, M. (2014). Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows. Journal of the Association for Information Science and Technology, 65(8), 1627-1638. https://doi.org/10.1002/asi.23071
  24. Nagarajan, A., Raamkumar, A. S., Erdt, M., Vijayakumar, H., Luo, F., Zheng, H. & Theng, Y. L. (2021). Altmetrics for research impact actuation (ARIA): An impact tracking tool for multidisciplinary and role-based cross-metric analysis. Journal of Altmetrics, 4(1). https://doi.org/10.29024/joa.36
  25. Ortega, J. L. (2015). Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC's members. Journal of Informetrics, 9(1), 39-49. https://doi.org/10.1016/j.joi.2014.11.004
  26. Ortega, J. L. (2020). Blogs and news sources coverage in altmetrics data providers: A comparative analysis by country, language, and subject. Scientometrics, 122(1), 555-572. https://doi.org/10.1007/s11192-019-03299-2
  27. Peters, I., Kraker, P., Lex, E., Gumpenberger, C. & Gorraiz, J. (2016). Research data explored: An extended analysis of citations and altmetrics. Scientometrics, 107(2), 723-744. https://doi.org/10.1007/s11192-016-1887-4
  28. Procter, R., Williams, R., Stewart, J., Poschen, M., Snee, H., Voss, A. & Asgari-Targhi, M. (2010). Adoption and use of Web 2.0 in scholarly communications. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 368(1926), 4039-4056. https://doi.org/10.1098/rsta.2010.0155
  29. Pulido, C. M., Redondo-Sama, G., Sorde-Marti, T. & Flecha, R. (2018). Social impact in social media: A new method to evaluate the social impact of research. PLoS ONE, 13(8), 1-20. https://doi.org/10.1371/journal.pone.0203117
  30. Saberi, M. K. & Ekhtiyari, F. (2019). Usage , captures , mentions , social media and citations of LIS highly cited papers : An altmetrics study. Performance Measurement and Metrics, 20(1), 37-47. https://doi.org/10.1108/PMM-10-2018-0025
  31. Sedighi, M. (2020). Evaluating the impact of research using the altmetrics approach (case study: the field of scientometrics). Global Knowledge, Memory and Communication. https://doi.org/10.1108/GKMC-02-2019-0013
  32. Seyyed Hosseini, S. & Basirian Jahromi, R. (2021). Iranian articles in medical ethics: An altmetrics approach on social media vs. a bibliometric study in scopus database. International Journal of Information Science and Management, 19(1), 15-26. Retrieved from https://ijism.ricest.ac.ir/article_698330_008924afc97e4933fccb7b246885e578.pdf
  33. Starbuck, E. & Sharon, P. (2016). Altmetric scores: Short-term popularity or long-term scientific importance. Digital Library Perspectives, 33(4), 314-323. https://doi.org/10.1108/DLP-10-2015-0020
  34. Tang, Y., Tseng, H. & Vann, C. (2020). Unwrap citation count, Altmetric Attention Score and Mendeley readership status of highly cited articles in the top-tier LIS journals. Global Knowledge, Memory and Communication, 69(8-9), 653-664. https://doi.org/10.1108/GKMC-01-2020-0005
  35. Thelwall, M. (2019). Do Mendeley reader counts indicate the value of arts and humanities research?. Journal of Librarianship and Information Science, 51(3), 781-788. https://doi.org/10.1177/0961000617732381
  36. Verma, S. & Madhusudhan, M. (2019a). Altmetric analysis of highly cited publications on digital library in Brazil and India: A comparative study. Library Philosophy and Practice, (e-journal). 2273. https://digitalcommons.unl.edu/libphilprac/2273?utm_source=digitalcommons.unl.edu%2Flibphilprac%2F2273&utm_medium=PDF&utm_campaign=PDFCoverPages
  37. Verma, S. & Madhusudhan, M. (2019b). An altmetric comparison of highly cited digital library publications of India and China. Annals of Library and Information Studies, 66(2), 71-75. http://op.niscair.res.in/index.php/ALIS/article/view/24409
  38. Vishakha, S. & Sarangapani, R. (2020). Scholarly communication of library and information science literature on social media: An altmetrics analysis. Library Philosophy and Practice (e-Journal). Retrieved from file:///C:/Users/drghane/Downloads/fulltext1.pdf
  39. Zhang, X., Wang, X., Zhao, H., Ordóñez de Pablos, P., Sun, Y., & Xiong, H. (2019). An effectiveness analysis of altmetrics indices for different levels of artificial intelligence publications. Scientometrics, 119(3), 1311-1344. https://doi.org/10.1007/s11192-019-03088-x
  40. Zhao, Y. & Wolfram, D. (2015). Assessing the popularity of the top‐tier journals in the LIS field on Twitter. Proceedings of the Association for Information Science and Technology, 52(1), 1-4. https://doi.org/10.1002/pra2.2015.145052010092

 

 

 

  • Receive Date 26 June 2022
  • Revise Date 31 January 2023
  • Accept Date 07 January 2023

Home

Guide for Authors

Submit Manuscript

Reviewers

Contact Us

Copyright Ownership