International Journal of Information Science and Management (IJISM)

Current Issue

By Issue

By Author

By Subject

Author Index

Keyword Index

About Journal

Aims and Scope

Editorial Board

Publication Ethics

Indexing and Abstracting

Peer Review Process

Journal Metrics

Open Access Policy

Language editing services

Altmetric vs. Citations: An In-Depth Analysis of Top-tier Cancer Research

Document Type : Original Article

Authors

1 Student Research Committee, School of Paramedicine, Tehran University of Medical Sciences, Tehran, Iran

2 Assistant prof., University Lecturer, Language Centre, University of Helsinki, Helsinki, Finland.

3 Associate Prof., Department of Medical Library and Information Sciences, School of Paramedicine, Hamadan University of Medical Sciences, Hamadan, Iran.

Abstract

 
In this study, we aimed to comprehensively analyze the altmetric indices of 1000 highly cited articles in the field of cancer, considering the growing importance of social media-based indicators as complementary tools alongside traditional bibliometric indicators for evaluating scientific outputs. Cancer research is a critical area in the medical community, being the second leading cause of death after cardiovascular diseases (CVDs). Conducted as a cross-sectional descriptive study, the bibliographic information of the research sample was obtained from the Scopus citation database. Data about the social media presence and altmetric attention scores (AAS) of each article were collected from the journal and altmetric.com. Subsequently, Excel and SPSS software were employed for analysis. Among the reviewed articles, 96.3% were shared on social media at least once, with Mendeley (99.6%), Patents (86.3%), and CiteULike (66.3%) being the most commonly used altmetric sources. The article titled "Dermatologist-level classification of skin cancer with deep neural networks," published in the Nature journal, obtained the highest AAS of 2864. Additionally, the majority of tweeters and readers were from the USA. Tweeters were predominantly members of the public, while readers were primarily professionals in medicine and dentistry, including PhD students. Spearman tests indicated a statistically significant moderate correlation between AASs and citations (r= 0.283, p-value< 0.001). Similarly, a significant weak correlation was observed between the journals' Impact Factor (IF) (r= 0.217) and CiteScore (r= 0.133) with the number of citations (p-value < 0.001). The findings of this study emphasize the positive impact of social media-based indicators on the number of citations received by scientific articles, making them valuable complementary measures alongside traditional citation indicators for evaluating research impact. We recommend that journals, authors, and researchers actively use social media platforms to enhance the visibility of their work and attract more citations.

Keywords

Main Subjects

References
Ahmadian, M., Mokhtari, H., Ghafari, S. & Saberi, M. K. (2021). Top ten journals publishing on COVID-19: A scientometric analysis. Journal of Otorhinolaryngology and Facial Plastic Surgery, 7(1). https://doi.org/10.22037/orlfps.v7i1.36165 
Ali, S. R., Dobbs, T. D., Slade, R. & Whitaker, I. S. (2021). Multidimensional indicators of scholarly impact in the skin oncology literature: is there a correlation between bibliometric and altmetric profiles? Journal of Plastic Surgery and Hand Surgery 55(4), 232-241. https://doi.org/10.1080/2000656x.2020.1858842
Altmetric (2023).  The donut and Altmetric Attention Score. Retrieved from  https://www.altmetric.com/about-us/our-data/donut-and-altmetric-attention-score/
Altmetric (2023).  What can Altmetric help you achieve? Retrievd from https://www.altmetric.com/
Bayar, B. & Peksöz, R. (2022). Analysis of trending topics in breast cancer articles from an altmetric perspective. Cureus, 14(7), e26565. https://doi.org/10.7759/cureus.26565 
Benjaminsen, T. A., Costalli, S., Grove, K., McConnell, F., Menga, F., Steinberg, P. E. & Vradis, A. (2019). Beyond bibliometrics. Political Geography, 68, A1-A2. https://doi.org/10.1016/j.polgeo.2018.12.004
Bornmann, L. (2014). Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime. Journal of Informetrics, 8(4), 935-950. https://doi.org/10.1016/j.joi.2014.09.007 
Chang, J., Desai, N. & Gosain, A. (2019). Correlation between altmetric score and citations in pediatric surgery core journals. Journal of Surgical Research, 243, 52-58. https://doi.org/10.1016/j.jss.2019.05.010 
Cho, J. (2017). A comparative study of the impact of Korean research articles in four academic fields using altmetrics. Performance Measurement and Metrics, 18(1), 38-51. https://doi.org/10.1108/PMM-02-2016-0005 
Costas, R., Zahedi, Z. & Wouters, P. (2015). Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003-2019. https://doi.org/10.1002/asi.23309  
 
Dardas, L. A., Woodward, A., Scott, J., Xu, H. & Sawair, F. A. (2019). Measuring the social impact of nursing research: An insight into altmetrics. Journal of Advanced Nursing, 75(7), 1394-1405. https://doi.org/10.1111/jan.13921 
Delli, K., Livas, C., Spijkervet, F. K. L. & Vissink, A. (2017). Measuring the social impact of dental research: An insight into the most influential articles on the Web. Oral Diseases, 23(8), 1155-1161. https://doi.org/10.1111/odi.12714 
Efron, N., Jones, L. W., Morgan, P. B. & Nichols, J. J. (2022). Bibliometric analysis of the literature relating to silicone hydrogel and daily disposable contact lenses. Journal of Optometry, 15(1), 44-52. https://doi.org/10.1016/j.optom.2021.05.003 
Erfanmanesh, A. (2017). The presence of iranian information science and library science articles in social media: An altmetric study. Iranian Journal of Information Processing Management and Management, 32(7)349-373. https://doi.org/10.35050/JIPM010.2017.045  
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M. & Thrun, S. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature, 542(7639), 115-118. https://doi.org/10.1038/nature21056 
Feijoo, J. F., Limeres, J., Fernández-Varela, M., Ramos, I. & Diz, P. (2014). The 100 most cited articles in dentistry. Clinical oral investigations, 18(3), 699-706. https://doi.org/10.1007/s00784-013-1017-0 
Fenner, M. (2014). Altmetrics and other novel measures for scientific impact. In S. Bartling & S. Friesike (Eds.), Opening Science: The Evolving Guide on How the Internet is Changing Research, Collaboration and Scholarly Publishing (pp. 179-189). Springer International Publishing. https://doi.org/10.1007/978-3-319-00026-8_12 
Floyd, A. R., Wiley, Z. C., Boyd, C. J. & Roth, C. G. (2021). Examining the relationship between altmetric score and traditional bibliometrics in the pathology literature. Journal of Pathology Informatics, 12, 8. https://doi.org/10.4103/jpi.jpi_81_20 
Gamble, J. M., Traynor, R. L., Gruzd, A., Mai, P., Dormuth, C. R. & Sketris, I. S. (2020). Measuring the impact of pharmacoepidemiologic research using altmetrics: A case study of a CNODES drug-safety article. Pharmacoepidemiology and Drug Safety, 29(S1), 93-102. https://doi.org/10.1002/pds.4401 
Goksoy, B. & Bozkurt, H. (2020). Social attention of the top 50 scientific articles on gastric cancer: Bibliometric and altmetric analysis. Journal of B.U.ON. : Official Journal of the Balkan Union of Oncology, 25(5), 2322-2331.
Grover, S., Elwood, A. D., Patel, J. M., Ananth, C. V. & Brandt, J. S. (2022). Altmetric and bibliometric analysis of obstetrics and gynecology research: influence of public engagement on citation potential. American Journal of Obstetrics and Gynecology, 227(2), 300. e301-300.e344. https://doi.org/10.1016/j.ajog.2022.03.013 
Hammarfelt, B. (2014). Using altmetrics for assessing research impact in the humanities. Scientometrics, 101(2), 1419-1430. https://doi.org/10.1007/s11192-014-1261-3
Haneef, R., Ravaud, P., Baron, G., Ghosn, L. & Boutron, I. (2017). Factors associated with online media attention to research: A cohort study of articles evaluating cancer treatments. Research Integrity and Peer Review, 2, 9. https://doi.org/10.1186/s41073-017-0033-z 
 
 
Hao, K. J., Jia, X., Dai, W. T., Huo, Z. M., Zhang, H. Q., Liu, J. W. & Wang, X. B. (2021). Mapping intellectual structures and research hotspots of triple negative breast cancer: A bibliometric analysis. Frontiers in Oncology, 11, 689553. https://doi.org/10.3389/fonc.2021.689553 
Hassona, Y., Qutachi, T., Dardas, L., Alrashdan, M. S. & Sawair, F. (2019). The online attention to oral cancer research: An Altmetric analysis. Oral Diseases, 25(6), 1502-1510. https://doi.org/10.1111/odi.13111 
Haustein, S., Costas, R. & Larivière, V. (2015). Characterizing social media metrics of scholarly papers: the effect of document properties and collaboration patterns. PLoS One, 10(3), e0120495. https://doi.org/10.1371/journal.pone.0120495 
Haustein, S., Larivière, V., Thelwall, M., Amyot, D. & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? IT - Information Technology, 56(5), 207-215. https://doi.org/10.1515/itit-2014-1048 
He, Y., Li, M., Yu, H., Yin, F., Zhang, X., Yang, Q., Xie, X., Wei, G., Chen, H., He, C., He, Y. & Chen, J. (2023). Bibliometric and altmetric analysis of research relating to antiphospholipid syndrome based on VOS viewer (2011-2021). Clinical Rheumatology, 42(5), 1285-1295. https://doi.org/10.1007/s10067-022-06485-5  
Kocyigit, B. F. & Akyol, A. (2021). Bibliometric and altmetric analyses of publication activity in the field of behcet's disease in 2010-2019. Journal of Korean medical science, 36(32), e207. https://doi.org/10.3346/jkms.2021.36.e207 
Kolahi, J., Iranmanesh, P. & Khazaei, S. (2017). Altmetric analysis of 2015 dental literature: A cross sectional survey. British Dental Journal, 222(9), 695-699. https://doi.org/10.1038/sj.bdj.2017.408 
Kolahi, J. & Khazaei, S. (2016). Altmetric: Top 50 dental articles in 2014. British Dental Journal, 220(11), 569-574. https://doi.org/10.1038/sj.bdj.2016.411 
Kolkailah, A. A., Fugar, S., Vondee, N., Hirji, S. A., Okoh, A. K., Ayoub, A., Al-Ogaili, A., Paz Rios, L. H., Kumar, S. K., Camacho, M. T., Rich, J. D. & Golzar, Y. (2019). Bibliometric Analysis of the Top 100 Most Cited Articles in the First 50 Years of Heart Transplantation. American Journal of Cardiology, 123(1), 175-186. https://doi.org/10.1016/j.amjcard.2018.09.010 
Lu, Y., Chan, Y.-T., Tan, H.-Y., Li, S., Wang, N. & Feng, Y. (2020). Epigenetic regulation in human cancer: the potential role of epi-drug in cancer therapy. Molecular Cancer, 19, 79. https://doi.org/10.1186/s12943-020-01197-3 
Masic, I. (2013). The importance of proper citation of references in biomedical articles. Acta Informatica Medica, 21(3), 148-155. https://doi.org/10.5455/aim.2013.21.148-155 
Mazov, N. A. & Gureev, V. N. (2015). Alternative approaches to assessing scientific results. Herald of the Russian Academy of Sciences, 85(1), 26-32. https://doi.org/10.1134/S1019331615010116
Moradi, S. & Alipour, O. (2017). The Characteristic of 100 top altmetrics articles. journal of Scientometrics Research, 5(2), 199-220. https://doi.org/10.22070/rsci.2019.3897.1248  or https://dorl.net/dor/20.1001.1.24233773.1398.5.10.11.6   [in Persian]
Nagai, H. & Kim, Y. H. (2017). Cancer prevention from the perspective of global cancer burden patterns. Journal of Thoracic Disease, 9(3), 448-451. https://doi.org/10.21037/jtd.2017.02.75 
 
Navidi, F. & Mansourian, Y. (2015). An Introduction to Altmetrics: Alternative Indicators to Explore the Impact of Research with an Emphasis on the Social Web. Journal of Scientometrics., 1(1), 1-20. http://doi.org/10.22070/RSCI.2015.372  or https://dorl.net/dor/20.1001.1.24233773.1394.1.1.2.1 [in Persian]
Nip, I. & Feng, H. (2022). Examining correlation of altmetric score and citation number in dermatology journal articles. Journal of Dermatological Treatment, 33(1), 297-299. https://doi.org/10.1080/09546634.2020.1750555 
Nocera, A. P., Boyd, C. J., Boudreau, H., Hakim, O. & Rais-Bahrami, S. (2019). Examining the correlation between altmetric score and citations in the urology literature. Urology, 134, 45-50. https://doi.org/10.1016/j.urology.2019.09.014 
Peres, M. F., Braschinsky, M. & May, A. (2022). Effect of altmetric score on manuscript citations: A randomized-controlled trial. Cephalalgia, 42(13), 1317-1322. https://doi.org/10.1177/03331024221107385 
Pooladian, A. & Borrego, Á. (2017). Twenty years of readership of library and information science literature under Mendeley’s microscope. Performance Measurement and Metrics, 18(1), 67-77. https://doi.org/10.1108/PMM-02-2016-0006
Powell, A., Bevan, V., Brown, C. & Lewis, W. G. (2018). Altmetric Versus Bibliometric Perspective Regarding Publication Impact and Force. World Journal of Surgery, 42(9), 2745-2756. https://doi.org/10.1007/s00268-018-4579-9 
Priem, J., Piwowar, H. A. & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. arXiv preprint arXiv:1203.4745. https://doi.org/10.48550/arXiv.1203.4745
Ravenscroft, J., Liakata, M., Clare, A. & Duma, D. (2017). Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements. PLoS One, 12(3), e0173152. https://doi.org/10.1371/journal.pone.0173152 
Robinson-García, N., Torres-Salinas, D., Zahedi, Z. & Costas, R. (2014). New data, new possibilities: Exploring the insides of Altmetric.com. Profesional de la Información, 23(4), 359-366. https://doi.org/10.3145/epi.2014.jul.03 
Rong, L. Q., Lopes, A. J., Hameed, I., Gaudino, M. & Charlson, M. E. (2020). Examining the correlation between Altmetric score and citation count in the anaesthesiology literature. British Journal of Anaesthesia, 125(2), e223-e226. https://doi.org/10.1016/j.bja.2020.04.086 
Shuaib, W. & Costa, J. L. (2015). Anatomy of success: 100 most cited articles in diabetes research. Therapeutic Advances in Endocrinology and Metabolism, 6(4), 163-173. https://doi.org/10.1177/2042018815580254 
Siegel, R. L., Miller, K. D., Fuchs, H. E. & Jemal, A. (2022). Cancer statistics, 2022. CA: A Cancer Journal for Clinicians, 72(1), 7-33. https://doi.org/10.3322/caac.21708 
The Genetics of Cancer (2022).  National Cancer Institute (NCI). Retrievd from https://www.cancer.gov/about-cancer/causes-prevention/genetics
Thelwall, M., Haustein, S., Larivière, V. & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PLoS One, 8(5), e64841. https://doi.org/10.1371/journal.pone.0064841
Tokar, A., Beurskens, M., Keuneke, S., Mahrt, M., Peters, I., Puschmann, C., Van Treeck, T. & Weller, K. (Eds.) (2012). Science and the Internet. Düsseldorf University Press.
 
Tornberg, H., Moezinia, C., Wei, C., Bernstein, S. A., Wei, C., Al-Beyati, R., Quan, T. & Diemert, D. J. (2023). Assessment of the dissemination of COVID-19-related articles across social media: Altmetrics study. JMIR Formative Research, 7, e41388. https://doi.org/10.2196/41388 
Wang, J. (2013). Citation time window choice for research impact evaluation. Scientometrics, 94(3), 851-872. https://doi.org/10.1007/s11192-012-0775-9 
Yi, K., Xu, J. G., Yang, K. L., Zhang, X., Ma, L., You, T. & Tian, J. H. (2022). The top-100 most cited articles of biomarkers in congenital heart disease: A bibliometric analysis. Annals of palliative medicine, 11(5), 1700-1713. https://doi.org/10.21037/apm-21-2422 
Yu, H., Xu, S., Xiao, T., Hemminger, B. M. & Yang, S. (2017). Global science discussed in local altmetrics: Weibo and its comparison with Twitter. Journal of Informetrics, 11(2), 466-482. https://doi.org/10.1016/j.joi.2017.02.011 
Zahedi, Z., Costas, R. & Wouters, P. (2014). How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications. Scientometrics, 101(2), 1491-1513. https://doi.org/http://doi.org/10.1007/s11192-014-1264-0  
International Journal of Information Science and Management (IJISM)
Volume 22, Issue 2
April 2024
Pages 105-122
Files
History
  • Receive Date: 01 August 2023
  • Revise Date: 27 March 2024
  • Accept Date: 27 March 2024
Share
How to cite
Statistics