Analyzing the Impacts of COVID-19 Vaccine Research Outputs: An Altmetric Approach

Document Type : Original Article

Authors

1 Scientometric Unit, Hormozgan University of Medical Sciences, Bandar Abbas, Iran

2 Information Management Research Unit, Islamic World Science and Technology Monitoring and Citation Institute (ISC), Shiraz, Iran.

3 Department of Health Information Technology, Faculty of Para-Medicine, Hormozgan University of Medical Sciences. Bandar Abbas, Iran

Abstract
 
This study aimed to investigate the attention given to scientific outputs about COVID-19 vaccines worldwide on social media. It utilized scientometrics and altmetrics indicators. A dataset with 12,364 works indexed in the WOS database from 2020 to 2022 was analyzed. Altmetric Scores (AS) and Altmetrics were extracted from Altmetric Explorer. Data analysis was performed using Access, Excel, and SPSS software. The retrieved articles garnered attention on 13 social media platforms.  The highest amount of social attention, accounting for 97% of the total, was related to X (Twitter) and Mendeley. The highest AS (43,765) was for an open-access article entitled "Covid-19: Researcher blows the whistle on data integrity issues in Pfizer's vaccine trial: Video 1" in the BMJ cited in 14 social media. The most productive countries in COVID-19 vaccine research were the USA, England, and China, while Harvard University, the University of London, and the University of California emerged as the most active research institutes. The findings confirmed a significant, moderate, and positive correlation between the AS and most Altmetrics with the number of citations. Additionally, a positive, substantial, and moderate correlation was observed between citations, the AS of highly-cited papers, and the AS of hot documents. Considering the positive impact of social media on increasing the chance of receiving more citations for articles and improving the impact range of articles from academic users to social users, the activities of researchers in social media are effective in increasing the visibility of scientific works.
 
 

Keywords

Subjects


 
Batooli, Z. & Sayyah, M. (2022). Measuring social media attention of scientific research on COVID-19: An investigation on article-level metrics data of dimensions. Journal of Educational & Psychological Research (JEPR), 4(2), 361, 368. Retrieved from https://www.opastpublishers.com/open-access-articles/measuring-social-media-attention-of-scientific-research-on-covid19-an-investigation-on-articlelevel-metrics-data-of-dime.pdf
Cascini, F., Pantovic, A., Al-Ajlouni, Y. A., Failla, G., Puleo, V., Melnyk, A., Lontano, A. & Ricciardi, W. (2022). Social media and attitudes towards a COVID-19 vaccination: A systematic review of the literature. EClinicalMedicine, 48, 101454. https://doi.org/10.1016/j.eclinm.2022.101454
Cho, J. (2021). Altmetrics of highly cited research papers in social science. Serials Review, 47(1), 17-27. https://doi.org/10.1080/00987913.2021.1882652
Costanzo, M., De Giglio, M. A. & Roviello, G. N. (2022). Anti-coronavirus vaccines: past investigations on SARS-CoV-1 and MERS-CoV, the approved vaccines from BioNTech/Pfizer, Moderna, Oxford/AstraZeneca and others under Development Against SARSCoV-2 Infection. Current Medicinal Chemistry, 29(1), 4-18. https://doi.org/10.2174/0929867328666210521164809
Costas, R., Zahedi, Z. & Wouters, P. (2015). Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003-2019. https://doi.org/10.1002/asi.23309
 
 
Critchfield, T. S. & Dixon, D. R. (2022). A scientist-practitioner’s guide to tracking personal dissemination impact: Using the altmetric attention score and bookmarklet.
Cronin, B. & Sugimoto, C. R. (2014). Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact. MIT press.
Cuesta-Cambra, U., Martínez-Martínez, L. & Niño-González, J. I. (2019). An analysis of pro-vaccine and anti-vaccine information on social networks and the internet: Visual and emotional patterns. Profesional de la Información, 28(2), e280217. https://doi.org/10.3145/epi.2019.mar.17
Cui, X., Wang, P. & Wei, Z. (2021). Emergency use of COVID-19 vaccines is recommended by the World Health Organization (WHO) as of June 2021. Drug Discoveries & Therapeutics, 15(4), 222-224. https://doi.org/10.5582/ddt.2021.01064
Fang, Z. & Costas, R. (2020). Tracking the Twitter attention around the research efforts on the COVID-19 pandemic.   https://doi.org/10.48550/arXiv.2006.05783
Fathizadeh, H., Afshar, S., Masoudi, M. R., Gholizadeh, P., Asgharzadeh, M., Ganbarov, K. & Kafil, H. S. (2021). SARS-CoV-2 (Covid-19) vaccines structure, mechanisms and effectiveness: A review. International Journal of Biological Macromolecules, 188, 740-750. https://doi.org/10.1016/j.ijbiomac.2021.08.076
Germani, F. & Biller-Andorno, N. (2021). The anti-vaccination infodemic on social media: A behavioral analysis. PLoS ONE, 16(3), e0247642. https://doi.org/10.1371/journal.pone.0247642
Golchin, M., Isfandyari-Moghaddam, A., Mirhosseini, Z., Famil Rohani, S. A. A. & Zarei, A. (2022). Investigating the presence of articles in Iranian journals indexed by Scopus via social media during 2010-2018. Scientometrics Research Journal, 8(15), 35-48. https://doi.org/10.22070/rsci.2020.5716.1418 [in Persian]
Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H. & Terliesner, J. (2014). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 101(2), 1145-1163. https://doi.org/10.1007/s11192-013-1221-3
Herrera-Peco, I., Jiménez-Gómez, B., Peña Deudero, J. J., Benitez De Gracia, E., & Ruiz-Núñez, C. (2021). Healthcare professionals’ role in social media public health campaigns: Analysis of Spanish pro-vaccination campaign on Twitter. Healthcare 9(6),662. https://doi.org/10.3390/healthcare9060662
Holmberg, K. & Park, H. W. (2018). An altmetric investigation of the online visibility of South Korea-based scientific journals. Scientometrics, 117(1), 603-613. https://doi.org/10.1007/s11192-018-2874-8
Hou, Z., Tong, Y., Du, F., Lu, L., Zhao, S., Yu, K., Piatek, S. J., Larson, H. J. & Lin, L. (2021). Assessing COVID-19 vaccine hesitancy, Confidence, and public engagement: A global social listening study. Journal of Medical Internet Research, 23(6), e27632. https://doi.org/10.2196/27632
Huang, W., Wang, P. & Wu, Q. (2018). A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals. PLoS ONE, 13(4), e0194962. https://doi.org/10.1371/journal.pone.0194962
Jain, V., Schwarz, L. & Lorgelly, P. (2021). A rapid review of COVID-19 vaccine prioritization in the US: alignment between federal guidance and state practice. International Journal of Environmental Research and Public Health, 18(7), 3483. https://doi.org/10.3390/ijerph18073483
Jeng, W., He, D. & Jiang, J. (2015). User participation in an academic, social networking service: A Mendeley survey of open group users. Journal of the Association for Information Science and Technology, 66(5), 890-904. https://doi.org/10.1002/asi.23225
Klar, S., Krupnikov, Y., Ryan, J. B., Searles, K. & Shmargad, Y. (2020). Using social media to promote academic research: Identifying the benefits of Twitter for sharing academic work. PLoS ONE, 15(4), e0229446. https://doi.org/10.1371/journal.pone.0229446
Kousha, K. & Thelwall, M. (2020). COVID-19 publications: Database coverage, citations, readers, tweets, news, Facebook walls, Reddit posts. Quantitative Science Studies, 1(3), 1068-1091. https://doi.org/10.1162/qss_a_00066
Liang, J. L., Tiwari, T., Moro, P., Messonnier, N. E., Reingold, A., Sawyer, M. & Clark, T. A. (2018). Preventing pertussis, tetanus, and diphtheria with vaccines in the United States: Recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recommendations and Reports, 67(2), 1-44. https://doi.org/10.15585/mmwr.rr6702a1
Liu, J. & Adie, E. (2013). Five challenges in altmetrics: A toolmaker's perspective. Bulletin of the American Society for Information Science and Technology, 39(4), 31-34. https://doi.org/10.1002/bult.2013.1720390410
Llewellyn, N. M. & Nehl, E. J. (2022). Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects? Clinical and Translational Science, 15(6), 1387-1392. https://doi.org/10.1111/cts.13251
Maddi, A. & Sapinho, D. (2022). Article processing charges, altmetrics, and citation impact: Is there an economic rationale? Scientometrics, 127(12), 7351-7368. https://doi.org/10.1007/s11192-022-04284-y
Moed, H. F. & Halevi, G. (2015). Multidimensional assessment of scholarly research impact. Journal of the Association for Information Science and Technology, 66(10), 1988-2002. https://doi.org/10.1002/asi.23314
Moorhead, S. A., Hazlett, D. E., Harrison, L., Carroll, J. K., Irwin, A. & Hoving, C. (2013). A new dimension of health care: Systematic review of the uses, benefits, and limitations of social media for health communication. Journal of Medical Internet Research, 15(4), e1933. https://doi.org/10.2196/jmir.1933
Pawlowski, C., Lenehan, P., Puranik, A., Agarwal, V., Venkatakrishnan, A. J., Niesen, M. J. M., O'Horo, J. C., Virk, A., Swift, M. D., Badley, A. D., Halamka, J. & Soundararajan, V. (2021). FDA-authorized mRNA COVID-19 vaccines are effective per real-world evidence synthesized across a multi-state health system. Med (New York, N.Y.), 2(8), 979–992.e8. https://doi.org/10.1016/j.medj.2021.06.007
Piwowar, H. (2013). Introduction altmetrics: What, why, and where? Bulletin of the American Society for Information Science and Technology, 39(4), 8-9. https://doi.org/10.1002/bult.2013.1720390404
Priem, J., Piwowar, H. A. & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. arXiv preprint arXiv:1203.4745. doi.org/10.48550/arXiv.1203.4745
Pulido, C. M., Redondo-Sama, G., Sordé-Martí, T. & Flecha, R. (2018). Social impact in social media: A new method to evaluate the social impact of research. PLoS ONE, 13(8), e0203117. https://doi.org/10.1371/journal.pone.0203117
 
 
Royal, A., Ahmad, S., Qureshi, A., Chaudhary, V., Jindal, T., Kumar, V. & Mehta, K. (2021). An altmetric analysis of online news on India's first indigenous COVID-19 vaccine. Journal of Education and Health Promotion, 10,348. https://doi.org/10.4103/jehp.jehp_1603_20
Sanders, J. G., Spruijt, P., van Dijk, M., Elberse, J., Lambooij, M. S., Kroese, F. M. & de Bruin, M. (2021). Understanding a national increase in COVID-19 vaccination intention, the Netherlands, November 2020-March 2021. Euro Surveillance: Bulletin Europeen sur les Maladies Transmissibles = European Communicable Disease Bulletin, 26(36), 2100792. https://doi.org/10.2807/1560-7917.ES.2021.26.36.2100792
Schnitzler, K., Davies, N., Ross, F. & Harris, R. (2016). Using Twitter™ to drive research impact: A discussion of strategies, opportunities, and challenges. International Journal of Nursing Studies, 59, 15-26. https://doi.org/10.1016/j.ijnurstu.2016.02.004
Sener, H. & Polat, O. A. (2022). Altmetric analysis of the most-cited 100 articles on the retina published between 2010 and 2020. Retina, 42(2), 283-289. https://doi.org/10.1097/IAE.0000000000003318
Shehata, A., El Dakar, M., & Salem, N. (2021, December). Top COVID-19 100 vaccine papers: An altmetric study. In 2021 22nd International Arab Conference on Information Technology (ACIT) (pp. 1-13). IEEE.
Sousa, J. A., Alves, I. A., Donato, H. & Sargento-Freitas, J. (2023). The Twitter factor: How does Twitter impact #Stroke journals and citation rates? International Journal of Stroke: Official Journal of the International Stroke Society, 18(5), 586–589. https://doi.org/10.1177/17474930221136704
Troiano, G. & Nardi, A. (2021). Vaccine hesitancy in the era of COVID-19. Public Health, 194, 245-251. https://doi.org/10.1016/j.puhe.2021.02.025
Thelwall, M. & Kousha, K. (2014). A cademia. Edu: Social network or academic network? Journal of the Association for Information Science and Technology, 65(4), 721-731. https://doi.org/10.1002/asi.23038
Thelwall, M. & Kousha, K. (2015). Web indicators for research evaluation. Part 1: Citations and links to academic articles from the Web. Profesional de la Información, 24(5), 587-606. https://doi.org/10.3145/epi.2015.sep.08 
Wouters, P., Zahedi, Z. & Costas, R. (2019). Social media metrics for new research evaluation. In Springer Handbook of Science and Technology Indicators (pp. 687-713). Cham: Springer International Publishing.
Yan, K., Barbati, J. L., Duncan, K. L., Warner, E. L. & Rains, S. A. (2023). Russian troll vaccine misinformation dissemination on Twitter: The role of political partisanship. Health Communication, 38(8), 1591-1600. https://doi.org/10.1080/10410236.2021.2021692
Yousefinaghani, S., Dara, R., Mubareka, S., Papadopoulos, A. & Sharif, S. (2021). An analysis of COVID-19 vaccine sentiments and opinions on Twitter. International Journal of Infectious Diseases, 108, 256-262. https://doi.org/10.1016/j.ijid.2021.05.059
Zhang, L., Fan, H., Peng, C., Rao, G. & Cong, Q. (2020). Sentiment analysis methods for HPV vaccine-related tweets based on transfer learning. Healthcare, 8(3), 307. https://doi.org/10.3390/healthcare8030307
Volume 22, Issue 4
Autumn 2024
Pages 39-55

  • Receive Date 26 November 2023
  • Revise Date 28 September 2024
  • Accept Date 28 September 2024