Designing a Framework for Ranking Iranian Universities and Higher Education Institutions

Document Type : Original Article

Authors

1 Professor Emeritus, Department of Knowledge & Information Science, Shahid Chamran University of Ahvaz, Ahvaz, Iran.

2 Assistant Prof., Department of Medical Library and Information Sciences, School of Allied Medical Sciences, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran

3 Professor Emeritus, Department of Knowledge and Information Science, School of Education & Psychology, Shahid Chamran University of Ahvaz, Ahvaz, Iran.

4 Associate Prof., Department of Management, Faculty of Economics and Social Sciences, Shahid Chamran University of Ahvaz, Ahvaz, Iran.

Abstract
Determining the criteria and indicators by which Iranian universities are evaluated
is essential to university ranking systems. This study aims to identify criteria and
indicators appropriate to Iranian universities and to develop a local framework for
ranking Iranian universities and higher education institutions. This study was carried
out using the fuzzy Delphi technique in six stages: the first stage was to identify the
existing rankings, the second stage was to extract criteria and indicators, the third
stage was to adjust the indicators based on frequency, and the fourth stage was to use
the fuzzy Delphi technique to obtain expert panel opinions, the fifth step is to use the
Analytic Hierarchy Process (AHP) for weighting and ranking indicators, and the
sixth step is to present a schematic view of the framework obtained. According to
findings, 145 studied rankings, 17 criteria, and 2709 indicators were identified. After
removing overlaps and homogenizing indicators, 17 criteria and 180 indicators were
selected for inclusion in the study checklist. Finally, based on the fuzzy Delphi
technique and AHP results, a ranking framework for Iranian universities comprising
11 criteria and 94 indicators was developed. The presented framework is designed
to meet the needs of Iranian universities to produce science and knowledge, foster
innovation and entrepreneurship, and develop technological products. 

Keywords

Subjects


Aguillo, I., Bar-Ilan, J., Levene, M. & Ortega, J. (2010). Comparing university rankings.
Scientometrics, 85(1), 243-256. https://doi.org/10.1007/s11192-010-0190-z
Aletaha, R., Jabbari, N. & Azari, N. (2019). Identification of Ranking Indexes in Iran's Medical
Sciences Universities. Journal of Sabzevar University of Medical Sciences, 26(1), 13-23.
Retrieved from
https://jsums.medsab.ac.ir/article_1155_90ae8aea7097ef4683d21e0d1e663e08.pdf?lang=
en [in Persian]
Alma, B., Coşkun, E. & Övendireli, E. (2016). University ranking systems and proposal of a
theoretical framework for ranking Turkish universities: A case of management
departments. Procedia-Social and Behavioral Sciences 235, 128-138.
https://doi.org/10.1016/j.sbspro.2016.11.008
Altakhaineh, A. & Zibin, A. (2021). A new perspective on university ranking methods
worldwide and in the Arab region: Facts and suggestions. Quality in Higher Education
27(3): 282-305. https://doi.org/10.1080/13538322.2021.1937819
Baldock, C. (2013). University rankings and medical physics. Australasian Physical &
Engineering Sciences in Medicine, 36(4), 375-378. https://doi.org/10.1007/s13246-013-
0234-9
Bastedo, M. & Bowman, N. (2010). US News & World Report college rankings: Modeling
institutional effects on organizational reputation. American Journal of Education 116(2),
163-183. https://doi.org/10.1086/649437
Benito, M. & Romera, R. (2011). Improving quality assessment of composite indicators in
university rankings: A case study of French and German universities of excellence.
Scientometrics, 89(1), 153-176. https://doi.org/10.1007/s11192-011-0419-5
Briggs, S. (2006). An exploratory study of the factors influencing undergraduate student choice:
the case of higher education in Scotland. Studies in Higher Education, 31(6), 705-722.
https://doi.org/10.1080/03075070601004333
311
Farideh Osareh / Parastoo Parsaei-Mohammadi / Abdolhossein Farajpahlou / Faraj-Allah Rahimi
IJISM, Vol. 22, No. 1 Ja nuary-March 2024
Çakır, M., Acartürk C., Alaşehir O. & Çilingir, C. (2015). A comparative analysis of global and
national university ranking systems. Scientometrics, 103(3), 813-848.
https://doi.org/10.1007/s11192-015-1586-6
Chaeddhananan, K. & Dhirathiti N. (2022). The model for the strategic drive of Thai higher
education institutions toward world-class universities. Kasetsart Journal of Social
Sciences, 43(2), 271-278.
Deem, R., Ho-Mok, K. & Lucas, L. (2008). Transforming higher education in whose image?
Exploring the concept of the ‘world-class’ university in Europe and Asia. Higher
Education Policy, 21(1), 83-97. http://dx.doi.org/10.1057/palgrave.hep.8300179
Doulati, H., Jafari-Tehrani, P. & Habib-Pour, F. (2013). Identification and prioritization of the
factors promoting research ranking of universities using a multi-criteria decision-making
method. European Journalof Experimental Biology, 3(2), 556-558. Retrieved from
https://www.primescholars.com/articles/identification-and-prioritization-of-the-factors-
promoting-research-ranking-of-universities-using-multicriteria-decision-making-me.pdf
Fakher, E., Aziz, A. & Zaranezhad, M. (2010). A study of ranking the faculties of Shahid
Chamran University using the TOPSIS technique. Journal of Educational Sciences, 15(3),
151-176. https://doi.org/10.22055/edus.2008.15750
Farasatkhah, M. (2008). A study of the existing and the desired state of the "scientific evaluation
system" in Iran, emphasizing the higher education sector. Journal of Science & Technology
Policy, 1(2), 43-58. https://www.magiran.com/paper/690611
[in Persian]
Feyzpur, M., Khanalizadeh, R. & Dehmobed, B. (2011). Comparative analysis of university
ranking indicators in the world and Iran. In the National Conference of Education in Iran,
Tehran. [in Persian]
García, F., Guijarro, F. & Oliver, J. (2021). A multicriteria goal programming model for ranking
universities. Mathematics, 9(5), 459. https://doi.org/10.3390/math9050459
Giannoulis, C. & Ishizaka, A. (2010). A Web-based decision support system with ELECTRE
III for a personalised ranking of British universities. DecisionSupport Systems 48(3), 488-
497. https://doi.org/10.1016/j.dss.2009.06.008
Hushyar-Sherwani, K. (2018). Comparative analysis of the national university ranking system
in the Kurdistan region and other national university Rankings: An emphasis on criteria
and methodologies. International Journal of Social Sciences & Educational Studies, 5(1),
7-15. https://doi.org/10.23918/ijsses.v5i1p7
Izadyar, S., Habibi, A. & Sarafrazi, A. (2014). Fuzzy multi-criteria decision making. Rasht:
Katibeh Gil.
Kaidesoja, T. (2022). A theoretical framework for explaining the paradox of university
rankings. Social Science Information, 61(1), 128-153.
https://doi.org/10.1177/05390184221079470
Karimyan, H., Salehi, K. & Naderi, E. (2013). Evaluation of the factors and indicators affecting
the quality of departments of library and information science: A case study of the library
and information science group of Tarbiat Moallem University of Tehran. Librarianship
and Information Organization Studies, 24(1), 9-26. Retrieved from
https://nastinfo.nlai.ir/article_78.html?lang=en [in Persian]
312
Designing a Framework for Ranking Iranian Universities and Higher Education Institutions
IJISM, Vol. 22, No. 1 January-March 2024
Khadivi, A. & Seyed Kalan, M. (2018). Affecting Factors on teaching quality in Farhangian
University (Case Study: College of Ardabil) Journal of Education and Evaluation, 11(42),
161-185. https://dorl.net/dor/20.1001.1.2423494.1397.7.1.2.6 [in Persian]
Lukman, R., Krajnc, D. & Glavič, P. (2010). University ranking using research, educational,
and environmental indicators. Journal of Cleaner Production, 18(7), 619-628.
https://doi.org/10.1016/j.jclepro.2009.09.015
Mapulanga, P. (2013). Changing economic conditions for libraries: Fundraising performance
in the University of Malawi libraries. The Bottom Line, 26(2), 59-69.
https://doi.org/10.1108/BL-12-2012-0035
Marginson, S. (2016). Global university ranking and performance improvement. What kind of
international academic relations are created by rankings? In Proceedings of the IREG-8
Conference, University rankings and academic international ties: A bridging tool or a
hindrance.
Mok, K. & Chan, Y. (2008). International benchmarking with the best universities: Policy
andpractice in mainland China and Taiwan. Higher Education Policy, 21(4), 469-486.
https://doi.org/10.1057/hep.2008.21
Montilla, J. (2004). The construct validation of an instrument based on students' university
choice and their perceptions of professor effectiveness and academic reputation at the
University of Los Andes. Doctoral Thesis. Department of Measurement & Research
College of Education, University of South Florida. Retrieved from
https://digitalcommons.usf.edu/cgi/viewcontent.cgi?article=2165&context=etd
Nisel, S. & Nisel, R. (2013). Using VIKOR methodology for ranking universities by academic
performance. GSTF Journal of Mathematics, Statistics and Operations Research
(JMSOR), 2(1), 86.
Olcay, G. & Bulu, M. (2016). Rankings of Turkish universities in international university
ranking indexes. Yüksekö¤retim Dergisi, 6(2), 95-103. https://doi.org/10.2399/yod.16.003
[in Turkish]
Pakzad, M., Khaledi, A. & Teymouri, M. (2012). Ranking of universities and higher education
centers. Rahyaft, 50,71-94. [in Persian]
Rahimi, H., Parand, K., Mohammadi, R. & Yadegarzadeh, G. (2002). Academic ranking:
Necessity, method, experiences. In the Meeting of heads of Iranian universities and
scientific and research centers, Tehran.
Rahmanpour, M., Yaghoubi, S., Ahmadi, S. & Bibi-Zamani, E. (2014). Examining the criteria
for accreditation and measuring higher education institutions with an emphasis on their
rankings. Journal of Higher Education Letter, 7(26), 11-47. Retrieved from
https://journal.sanjesh.org/article_14876_762d6bf648d7a21d3816b221bdac8d0e.pdf?lang
=en [in Persian]
Robinson-García, N., Torres-Salinas, D., Delgado López-Cózar, E. & Herrera, F. (2014). An
insight into theimportance of national university rankings in an international context: the
case of the I-UGR rankings of Spanish universities. Scientometrics, 101(2), 1309-1324.
https://doi.org/10.1007/s11192-014-1263-1
Safiei, M., Amini, M. & Aboeiarkani, M. (2016). A model for evaluating and ranking Iranian
universities by composite index. Quarterly Journal of The Macro and Strategic Policies
4(14), 1-25. [in Persian]
313
Farideh Osareh / Parastoo Parsaei-Mohammadi / Abdolhossein Farajpahlou / Faraj-Allah Rahimi
IJISM, Vol. 22, No. 1 Ja nuary-March 2024
Saffie, N. A. M. & Rasmani, K. A. (2016). Fuzzy delphi method: Issues and challenges. In the
2016 International Conference on Logistics, Informatics and Service Sciences (LISS) (pp.
1-7). IEEE. https://doi.org/10.1109/LISS.2016.7854490
Sanoff, A., Usher, A., Savino, M. & Clarke, M. (2007). College and University Ranking
Systems: Global Perspectivesand American Challenges. Institute for Higher Education
Policy. Retrieved from https://files.eric.ed.gov/fulltext/ED497028.pdf
Shahi, M. & Alavi-Moghaddam, M. (2017). Rank comparison between Amirkabir and Sharif
Universities of Technology based on selected global ranking systems. Science and
Technoligi Policy Letters, 7(1), 31-40.
https://dorl.net/dor/20.1001.1.24767220.1396.07.1.6.6 [in Persian]
Sohrabi, Z., Yousefi, M., Fazaeli, S., Mohebifar, R., Moradi, G., Azimi, A. (2011). Rating of
Iranian Medical Sciences Universities in education, based on the efficiency index. Iranian
Journal of Medical Education, 11(4), 408-417. Retrieved from
https://ijme.mui.ac.ir/article-1-1110-fa.pdf [in Persian]
Stolz, I., Hendel, D. & Horn, A. (2010). Ranking of rankings: Benchmarking twenty-five higher
education ranking systems in Europe. Higher education, 60(5), 507-528.
https://doi.org/40864829
Taylor, P. & Braddock, R. (2007). International university ranking systems and the idea of
university excellence. Journal of Higher Education Policy and Management, 29(3), 245-
260. https://doi.org/10.1080/13600800701457855
Wu, H., Chen, J., Chen, I. & Zhuo, H. (2012). Ranking universities based on performance
evaluation by a hybrid MCDM model. Measurement, 45(5), 856-880.
https://doi.org/10.1016/j.measurement.2012.02.009
Zare Banadkooki, M., Vahdatzad, M., Owlia, M. & Lotfi, M. (2016). The study of effective
measures for Iranian university rankings from upstream documents. Journalof Science &
Technology Policy, 9(3), 55-70. https://dorl.net/dor/20.1001.1.20080840.1395.9.3.6.2 [in
Persian]
Volume 22, Issue 1 - Serial Number 1
Winter 2024
Pages 295-315

  • Receive Date 22 February 2023
  • Revise Date 26 December 2023
  • Accept Date 26 December 2023