International Journal of Information Science and Management (IJISM)

Does Altmetric Attention Score of Articles on Diabetes Mellitus Correlate with their Citations in Google Scholar, Scopus, Web of Science and Dimensions?

Document Type : Articles

Authors

Maryam Esmaeilzadeh 1
Shokoufeh Bonakdaran 1
Heidar Mokhtari 2
Ali Ouchi 3

1 Department of Endocrinology and Metabolism, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran.

2 Department of Knowledge and Information Science, Payame Noor University, Tehran, Iran.

3 Student Research Committee, School of Health Management and Information Sciences Branch, Iran University of Medical Sciences, Tehran, Iran

https://doi.org/10.22034/ijism.2023.1977844.0
Abstract
This applied altmetric study aimed to analyze the presence of highly-cited documents on diabetes mellitus in online social media and correlate their altmetric attention scores with their received citation counts. Twenty thousand highly-cited documents on diabetes mellitus were identified in Scopus and their altmetric attention scores (ASSs) were extracted from Altmetric Explorer (Altmetric LLP, London, UK). Received citation rates of the documents were extracted from Google Scholar, Scopus, Web of Science and Dimensions. Excell 2016 and SPSS 22 were used for data statistical description and analysis. Out of 19,383 DOI-owner highly-cited documents on diabetes mellitus, 16,076 (82.94%) were shared at least once in social media and had an altmetric attention score. Mendeley ranked first in sharing documents with 16,868 documents (87.02%). Six hundred forty-six thousand one hundred eighty-four tweets were tweeted on the studied documents from 222 countries, with the United States as first-ranked country (17,453 tweets, 18.2%). The highest-mentioned journal was the Lancet, and the highest-mentioned research institute was Harvard University. A significantly positive correlation was found between the altmetric attention scores of the studied documents and their citation counts in Google scholar (r= .842, p<.01), Scopus (r=.855, p<.01), Web of Science (r=.709, p<.05) and Dimensions (r= .841, p< .01). Regarding the central role of presence in social media in increasing the visibility and citability of documents, researchers must use the potentiality of social media and Web 2 tools for more sharing their scientific works and increasing the influence of their research output. In this study the relationship between the presence of documents in online social media and tools and their received citation rates was investigated in a large sample (20,000 diabetes mellitus documents). The results benefit researchers and research administrators for sharing and publicizing research output in social media.

Keywords

Social media
Altmetrics
Bibliometrics
Citations
Highly-cited papers
  1. AlRyalat, S.A., Al Oweidat, K., Al-Essa, M., Ashouri, K., El Khatib, O., Al-Rawashdeh, A., Yaseen, A., Toumar, A. & Alrwashdeh, A. (2022). Influenza Altmetric Attention Score and its association with the influenza season in the USA. F1000Research, 9, 96. https://doi.org/10.12688%2Ff1000research.22127.3
  2. Altmetric (2018). Patent data in altmetric highlights the commercialization of research–Altmetric. Retrieved from https://www.altmetric.com/press/press-releases/patent-data-in-altmetric-highlights-the-commercialization-of-research/
  3. Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H. & Terliesner, J. (2012). Beyond citations: Scholars' visibility on the social Web. arXiv Preprint arXiv:5611
  4. Bonyadi Naeini, A. & Moghiseh, Z. (2021). The presence of neuromarketing scientific publications in social media: An altmetric study. New Marketing Research Journal, 11(1), 27-44. https://doi.org/10.22108/nmrj.2021.125291.2250 [in Persian]
  5. Brigham, T. J. (2014). An introduction to altmetrics. Medical Reference Services Quarterly, 33(4), 438-447. https://doi.org/10.1080/02763869.2014.957093
  6. Chen, J. & Zhang, Q. (2021). An Altmetric Study on Dental Informatics. In Advances in Computer Vision and Computational Biology: Proceedings from IPCV'20, HIMS'20, BIOCOMP'20, and BIOENG'20 (pp. 625-637). Cham: Springer International Publishing.
  7. Chien, J.L., Sabharwal, J., Namoglu, E.C., Ghassibi, M.P., Yuan, M., Gandy, C., Wei, C., Somohano, K., Engelhard, S.B., Petrakos, P. & Van Tassel, S.H. (2022). The 100 most mentioned glaucoma articles online with highest altmetric attention scores. Journal of Glaucoma, 31(1), 8-14. https://doi.org/10.1097/ijg.0000000000001939
  8. Costas, R., Zahedi, Z. & Wouters, P. (2015). Do "altmetrics" correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003-2019. https://doi.org/10.1002/asi.23309
  9. Dagar, A. & Falcone, T. (2021). Altmetric scores analysis reveals a high demand for psychiatry research on social media. Psychiatry Research, 298, https://doi.org/10.1016/j.psychres.2021.113782
  10. Galligan, F. & Dyas-Correia, S. (2013). Altmetrics: Rethinking the way we measure. Serials Review, 39(1), 56-61. https://doi.org/10.1016/j.serrev.2013.01.003
  11. Gould, H.P., Bano, J.M., Rate, W., Civilette, M., Cohen, A.S., Samuelson, E.R., Haislup, B. & Bodendorfer, B.M.  (2022). The top 100 most- Impactful articles on the Achilles Tendon: An altmetric analysis of online media. Foot & Ankle Orthopaedics, 7(1), 2473011421S2473000218. https://doi.org/10.1177%2F2473011421S00218
  12. Hammarfelt, B. (2014). Using altmetrics for assessing research impact in the humanities. Scientometrics, 101(2), 1419-1430. https://doi.org/10.1007/s11192-014-1261-3
  13. Hassona, Y., Qutachi, T., Dardas, L., Alrashdan, M. S. & Sawair, F. (2019). The online attention to oral cancer research: An altmetric analysis. Oral Diseases, 25(6), 1502-1510. https://doi.org/10.1111/odi.13111
  14. Haustein, S. (2014). Readership Metrics. In Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact, Blaise Cronin and Cassidy R. Sugimoto (Eds.), 327-392. MIT Press.
  15. Haustein, S., Costas, R. & Larivière, V. (2015). Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PloS One, 10(3), e0120495. https://doi.org/10.1371/journal.pone.0120495
  16. Haustein, S., Larivière, V., Thelwall, M., Amyot, D. & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? IT-Information Technology, 56(5), 207-215. https://doi.org/10.1515/itit-2014-1048
  17. Heshmati, B., Hashempour, L., Saberi, M. K., Fattahi, A. & Sahebi, S. (2020). Global research trends of public libraries from 1968 to 2017: A bibliometric and visualization analysis. Webology, 17(1), 140-157. http://doi.org/10.14704/WEB/V17I1/a213
  18. Kandimalla, R., Thirumala, V. & Reddy, P. H. (2017). Is alzheimer's disease a type 3 diabetes? A critical appraisal. Biochimica et Biophysica Acta (BBA)-Molecular Basis of Disease, 1863(5), 1078-1089. https://doi.org/10.1016/j.bbadis.2016.08.018
  19. Kim, J.-E., Kim, Y., Park, K. M., Yoon, D. Y. & Bae, J. S. (2019). Top 100 publications as measured by altmetrics in the field of central nervous system inflammatory demyelinating disease. BioMed Research International, https://doi.org/10.1155/2019/3748091
  20. Li, X., Thelwall, M. & Giustini, D. (2012). Validating online reference managers for scholarly impact measurement. Scientometrics, 91(2), 461-471. https://doi.org/10.1007/s11192-011-0580-x
  21. Liu, C. L., Xu, Y. Q., Wu, H., Chen, S. S. & Guo, J. J. (2013). Correlation and interaction visualization of altmetric indicators extracted from scholarly social network activities: dimensions and structure. Journal of medical Internet research, 15(11), e259. https://doi.org/10.2196/jmir.2707
  22. Melero, R. (2015). Altmetrics–a complement to conventional metrics. Biochemia Medica: Biochemia Medica, 25(2), 152-160. https://doi.org/10.11613%2FBM.2015.016
  23. Mokhtari, H., Barkhan, S., Haseli, D. & Saberi, M. K. (2021). A bibliometric analysis and visualization of the Journal of Documentation: 1945–2018. Journal of Documentation. 77(1), 69-92. https://doi.org/10.1108/JD-08-2019-0165
  24. Neylon, C. & Wu, S. (2009). Level metrics and the evolution of scientific impact. PLoS Biology, 7(11), e1000242. https://doi.org/10.1371/journal.pbio.1000242
  25. Nocera, A. P., Boyd, C. J., Boudreau, H., Hakim, O. & Rais-Bahrami, S. (2019). Examining the correlation between altmetric score and citations in the urology literature. Urology, 134, 45-50. https://doi.org/10.1016/j.urology.2019.09.014
  26. Ogurtsova, K., da Rocha Fernandes, J.D., Huang, Y., Linnenkamp, U., Guariguata, L., Cho, N.H., Cavan, D., Shaw, J.E. & Makaroff, L.E. (2017). IDF Diabetes Atlas: Global estimates for the prevalence of diabetes for 2015 and 2040. Diabetes research and clinical practice, 128, 40-50. https://doi.org/10.1016/j.diabres.2017.03.024
  27. Ouchi, A., Saberi, M. K., Ansari, N., Hashempour, L. & Isfandyari-Moghaddam, A. (2019). Do altmetrics correlate with citations? A study based on the 1,000 most-cited articles. Information Discovery and Delivery. 47(4), 192-202. https://doi.org/10.1108/IDD-07-2019-0050
  28. Piwowar, H. (2013). Value all research products. Nature, 493(7431), 159-159. https://doi.org/10.1038/493159a
  29. Pooladian, A. & Borrego, Á. (2017). Twenty years of readership of library and information science literature under Mendeley's microscope. Performance Measurement and Metrics, 18(1), 67-77. https://doi.org/10.1108/PMM-02-2016-0006
  30. Priem, J. & Costello, K. L. (2010). How and why scholars cite on Twitter. Proceedings of the American Society for Information Science and Technology, 47(1), 1-4. https://doi.org/10.1002/meet.14504701201
  31. Priem, J., Groth, P. & Taraborelli, D. (2012). The altmetrics collection. PloS One, 7(11). e48753. https://doi.org/10.1371/journal.pone.0048753
  32. Priem, J., Piwowar, H. A. & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. https://doi.org/10.48550/arXiv.1203.4745
  33. Priem, J., Taraborelli, D., Groth, P. & Neylon, C. (2010). Altmetrics: A manifesto. Retrieved from http://altmetrics.org/manifesto/
  34. Repiso, R., Castillo-Esparcia, A. & Torres-Salinas, D. (2019). Altmetrics, alternative indicators for Web of Science communication studies journals. Scientometrics, 119(2), 941-958. https://doi.org/10.1007/s11192-019-03070-7
  35. Richardson, M. A., Park, W., Echternacht, S. R. & Bell, D. E. (2021). Altmetric attention score: Evaluating the social media impact of burn research. Journal of Burn Care & Research, 42(6), 1181-1185. https://doi.org/10.1093/jbcr/irab026
  36. Robinson-García, N., Torres-Salinas, D., Zahedi, Z. & Costas, R. (2014). New data, new possibilities: Exploring the insides of Altmetric.com. Profesional De La información, 23(4), 359-366. https://doi.org/10.3145/epi.2014.jul.03
  37. Saberi, M. K., Isfandyari-Moghaddam, A. & Mohamadesmaeil, S. (2011). Web citations analysis of the JASSS: The first ten years. Journal of Artificial Societies and Social Simulation, 14(4), 22-23. https://doi.org/ 10.18564/jasss.1803  
  38. Semeraro, F., Cancarini, A., Rezzola, S., Romano, M. R. & Costagliola, C. (2015). Diabetic retinopathy: Vascular and inflammatory disease. Journal of Diabetes Research, 45(6), 517-527. https://doi.org/10.1016/j.diabet.2019.04.002
  39. Sener, H. & Polat, O. A. (2022). Altmetric analysis of the most-cited 100 articles on the retina published between 2010 and 2020. Retina, 42(2), 283-289. https://doi.org/10.1097/iae.0000000000003318
  40. Shamsi, A., Lund, B. D. & SeyyedHosseini, S. (2022). Sharing of retracted COVID-19 articles: an altmetric study. Journal of the Medical Library Association: JMLA, 110(1), 97-105. https://doi.org/10.5195%2Fjmla.2022.1269
  41. Thelwall, M., Haustein, S., Larivière, V. & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PloS One, 8(5), e64841. https://doi.org/10.1371/journal.pone.0064841
  42. Trueger, N. S., Thoma, B., Hsu, C. H., Sullivan, D., Peters, L. & Lin, M. (2015). The altmetric score: A new measure for article-level dissemination and impact. Annals of Emergency Medicine, 66(5), 549-553. http://dx.doi.org/10.1016/j.annemergmed.2015.04.022
  43. Zahedi, Z. (2014). Analyzing readerships of international Iranian publications in Mendeley: An altmetrics study. Presented at the first National Scientometrics Conference, 21-22 May, 2014, Isfahan University, Iran. Retrieved from https://arxiv.org/ftp/arxiv/papers/1505/1505.01342.pdf [in Persian]

 

 

International Journal of Information Science and Management (IJISM)
Volume 21, Issue 2 - Serial Number 2
Spring 2023
Pages 127-139

  • Receive Date 22 May 2022
  • Revise Date 13 March 2023
  • Accept Date 17 January 2023

Home

Guide for Authors

Submit Manuscript

Reviewers

Contact Us

Copyright Ownership