Document Type : Original Article
Authors
1 MA, Knowledge and Information Science, Ferdowsi University of Mashhad, Mashhad, Iran
2 Assistant Professor, Department of Knowledge and Information Science, Ferdowsi University of Mashhad, Mashhad, Iran
3 Professor, Department of Knowledge and Information Science, Ferdowsi University of Mashhad, Mashhad, Iran
Abstract
This study aimed to identify the quality of web pages retrieved by Parsijoo and Parseek Persian search engines and Google to respond to students' course-related queries. This study was conducted using evaluations from a researcher-made checklist. The first population included Persian and Google search engines selected from Persian, Parsijoo, and Parseek search engines. The second population included the keywords of the section for collecting data from the fourth, fifth, and sixth-grade elementary school science textbooks, from which 12 keywords were selected by simple random sampling. The third population included web pages retrieved for each keyword by search engines. From the first ten results retrieved in each keyword search, relevant pages were selected as the sample. The results revealed that the quality of the web pages retrieved by all three search engines, i.e., Parsijoo, Parseek, and Google, was above average. However, there was a significant difference between the engines regarding the number of relevant results. This is the first study investigating the quality of web pages retrieved by search engines to respond to students' course-related queries. The study results can help the designers and developers of Persian search engines improve their performance in retrieving high-quality pages and gaining a proper place among Iranian users.
Keywords
Main Subjects
Aghaee, A., Ghaebi, A. & Kamran, M. (2015). Persian search engines efficiency: Views of postgraduate students. Librarianship and Information Organization Studies, 25(4), 101-113. [in Persian]
ALA. (1997). Great web sites for kids selection criteria. Retrieved from https://www.ala.org/ala/alsc/greatwebsites/greatwebsitesforkids/greatwebsites.htm
Ali, F. & Khusro, S. (2021). Content and link-structure perspective of ranking webpages: A review. Computer Science Review, 40,100397. https://doi.org/10.1016/j.cosrev.2021.100397
AlSobh, A., Al Oroud, A., Al-Kabi, M. N. & AlSmadi, I. (2010). A multilingual and location evaluation of search engines for websites and searched for keywords. Brazilian Journal of Information Science, 4(1), 2-17.
Bagherinasab, F. (2011). Investigation and ranking of Shi a Farsi websites based on the checklist designed by the criteria of Silberg, SMRT, and Action for Health. Research on Information Science & Public Libraries, 17(2), 305-336. [in Persian]
Bakhshipour, M. (2021, April 28). Why the government failed in the search engine project. Mehr News Agency. https://www.mehrnews.com/news/5199066 [in Persian]
Baranchikov, A. I., Svirina, A. G., Grinchenko, N. N. & Sumenkov, N. A. (2018, June). A technique of increasing the efficiency of websites' ranking based on the spectral coefficient of the texts' readability. In 2018 7th Mediterranean Conference on Embedded Computing (MECO) (pp. 1-5). IEEE. https://doi.org/10.1109/MECO.2018.8406044
Bouramoul, A., Kholladi, M. K. & Doan, B. L. (2011). Using context to improve the evaluation of information retrieval systems. International Journal of Database Management Systems (IJDMS), 3(2), 22-39. https://centralesupelec.hal.science/hal-00659052
Demirci, R. G., Kismir, V., & Bitirim, Y. (2007, May). An evaluation of popular search engines on finding turkish documents. In Second International Conference on Internet and Web Applications and Services (ICIW'07) (pp. 61-61). IEEE. https://doi.org/10.1109/ICIW.2007.15
Erfanmanesh, M. A. & Didegah, F. (2010). Evaluating function of Persian search engines on the web using correspondence analysis. International Journal of Information Science and Management (IJISM), 8(2), 77-87. Retrieved from https://ijism.isc.ac/article_698150_46533a159ff3ecf54ea95a49a4c70584.pdf
Farhadpour, M. & Khalaf Abadi, R. (2015). Qualitative evaluation of Iranian children and young adult's websites using Web-QEM model. Librarianship and Information Organization Studies, 26(2), 91-110. [in Persian]
Ghavidel, S. Niazmand, M. R. & Khaleghi, N. (2018). Usage of Iranian users of national and international search engines. Journal of Sciences and Techniques of Information Management, 4(1), 65-89. https://dorl.net/dor/20.1001.1.24766658.1397.4.1.5.0 or https://doi.org/10.22091/stim.2018.2364.1162 [in Persian]
Golzardi, E., Meghdadi, M. & Qaderzadeh, A. B. (2013, December 19). Comparison of the performance of common search engines in searching Persian web pages. In Conference on Computer Engineering and Sustainable Development with a Focus on Computer Networks, Mashhad. [in Persian]
Gossen, T. (2016). Search engines for children: Search user interfaces and information-seeking behaviour. Springer Vieweg.
Gossen, T., Kotzyba, M., & Nürnberger, A. (2017). Search engine for children: User-centered design. Datenbank-Spektrum, 17(1), 61–67.
Gregurec, I. & Grd, P. (2012, September). Search Engine Optimization (SEO): Website analysis of selected faculties in Croatia. In Proceedings of Central European Conference on Information and Intelligent Systems (pp. 211-218).
Jalal, S. K. (2019). Exploring web link analysis of websites of Indian institute of technology. DESIDOC Journal of Library & Information Technology, 39(1), 3-9. https://doi.org/10.14429/djlit.39.1.13692
Khaki Farrokhad, M. S. (2021). Evaluation of Iranian search engines subject coverage in Comparison with Google by using Dewey Decimal Classification. Unpublished master's thesis. Ferdowsi University of Mashhad. [in persian]
Lambrecht, P. & Peter, M. K. (2022). The influence of digital assistants on search engine strategies: Recommendations for voice search optimization. In Marketing and Smart Technologies: Proceedings of ICMarkTech 2021, Volume 2 (pp. 665-672). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-16-9272-7_55
Lewandowski, D. (2008). A three-year study on the freshness of web search engine databases. Journal of Information Science, 34(6), 817-831. https://doi.org/10.1177/0165551508089396
Lewandowski, D. & Schultheiß, S. (2023). Public awareness and attitudes towards search engine optimization. Behaviour & Information Technology, 42(8), 1025-1044. https://doi.org/10.1080/0144929X.2022.2056507
Loiacono, E.T., Watson, R. T. & Goodhue, D. L. (2002). WebQual: A measure of website quality. Marketing Theory and Applications, 13(3), 432-438.
Lopriore, G. (2022). How and to what extent are e-consumer perceptions of website success reflected in basic website performance metrics? Master’s thesis, Université Cath Lique de Louvain. http://hdl.handle.net/2078.1/thesis:33635
Luyt, B., Goh, D. & Lee, C.S. (2009). Searching locally: A comparison of Yehey! and Google. Online Information Review, 33(3), 499-510. https://doi.org/10.1108/14684520910969925
Macedo-Rouet, M., Potocki, A., Scharrer, L., Ros, C., Stadtler, M., Salmerón, L. & Rouet, J. F. (2019). How good is this page? Benefits and limits of prompting on adolescents’ evaluation of web information quality. Reading Research Quarterly, 54(3), 299-321. https://doi.org/10.1002/rrq.241
Machill, M., Neuberger, C. & Schindler, F. (2003). Transparency on the net: Functions and deficiencies of Internet search engines. Info: The Journal of Policy, Regulation and Strategy for Telecommunications, Information and Media, 5(1), 52–74. https://doi.org/10.1108/14636690310473890
Mandl, T. (2006). Implementation and evaluation of a quality-based search engine. In The Seventeenth Conference on Hypertext and Hypermedia, Association for Computing Machinery. (pp. 73-84). New York, NY, United States. https://doi.org/10.1145/1149941.1149957
McInerney, C. R. & Bird, N. J. (2005). Assessing website quality in context: Retrieving information about genetically modified food on the web. Information Research, 10(2), paper 213. Retrieved from https://www.informationr.net/ir/10-2/paper213.html
Morvarid, N., Behzadi, H. & Radad, I. (2016). Qualitative ranking of Persian and non-Persian search engines in information retrieval of Islamic subjects. Journal of Library and Information Science, 19(3), 44-72. [in Persian]
Namk, M. J. & Bitirim, Y. (2015). An evaluation of international web search engines’ performances based on English, Arabic and Turkish languages in various categories. International Journal of Scientific Knowledge, 5(8), 14-20.
Nouri Afkand, A., Matlabi, D. & Alipour Hafezi, M. (2013). Assessment of LIS journal's website based on website quality evaluation tools (WQET) and presentation of offered pattern. Journal of Information Systems and Services, 2(3), 1-12. [in Persian]
Nowkarizi, M. & Zeynali Tazehkandi, M. (2017). The overlap and coverage of 4 local search engines: Parsijoo, Yooz, Parseek and Rismoun. Human Information Interaction, 4(3), 48-59. [in Persian]
Nowkarizi, M. & Zeynali Tazehkandi, M. (2019). Rethinking the recall measure in appraising information retrieval systems and providing a new measure by using Persian search engines. International Journal of Information Science and Management (IJISM), 17(1), 1-16. Retrieved from https://ijism.isc.ac/article_698287_b86969c2c323c25fdddf684131ffd5de.pdf
Office for National Statistics of UK (2021). Children’s online behavior in England and Wales: Year ending March 2020. Retrieved from https://www.ons.gov.uk/peoplepopulationandcommunity/crimeandjustice/bulletins/childrensonlinebehaviourinenglandandwales/yearendingmarch2020
Olsina, L., Godoy, D., Lafuente, G. & Rossi, G. (1999). Assessing the quality of academic websites: A case study. New Review of Hypermedia and Multimedia, 5(1), 81-103. https://doi.org/10.1080/13614569908914709
Paananen, A. (2012). Comparative analysis of Yandex and google search engines. Master’s thesis, Helsinki Metropolia University of Applied Sciences.
Rajabi, M. & Norouzi, Y. (2015). Persian search engines: evaluating search features, information retrieval, precision and recall and their overlaps. Librarianship and Information Organization Studies, 26(3), 133-150. [in Persian]
Ramachandran, S., Paulraj, S., Joseph, S. & Ramaraj, V. (2009). Enhanced trustworthy and high-quality information retrieval system for web search engines. International Journal of Computer Science, 5(1), 38-42. Retrieved from https://web-archive.southampton.ac.uk/cogprints.org/6724/1/IJCSI-5-38-42.pdf
Salehi, H. (2015). Comparison of the external design of Iranian and non-Iranian children's educational websites (by studying 4 selected cases). Unpublished master’s thesis. Ferdous Institute of Higher Education. [in Persian]
Sellamuthu, K., Ranjithkumar, S., Kavitha, K. & Gowtham, S. (2022, April). On page SEO techniques for better ranking in search engines. In 2022 8th International Conference on Smart Structures and Systems (ICSSS) (pp. 01-06). IEEE. Saveetha Engineering College, Chennai, India. https://doi.org/10.1109/ICSSS54381.2022.9782182
Serrano-Cinca, C. & Muñoz-Soro, J. F. (2018). What municipal websites supply and citizens demand: A search engine optimisation approach. Online Information Review, 43(1), 7-28. https://doi.org/10.1108/OIR-02-2018-0042
ShahrabiFarahani, N., Shekofteh, M., Kazerani, M. & Emami, Z. (2018). An evaluation of Persian diabetes websites based on WebMedQual (2016). Iranian Journal of Endocrinology and Metabolism, 20(3), 142-150. Retrieved from https://ijem.sbmu.ac.ir/article-1-2352-en.pdf [in Persian]
Sharifi, M. (April 8, 2021). Access of Iranian users to Google services. Mehr news agency. https://www.mehrnews.com/news/5184016/
Sotudeh, H. & Honarjooyan, Z. (2013). Persian language challenges in the digital environment and their impact on the effectiveness of automated text processing and information retrieval. Library and Information Science, 15(4), 59-92. Retrieved from https://lis.aqr-libjournal.ir/article_42651_05011294ef5c5cbaa8986071ca229087.pdf?lang=en [in Persian]
Statistical Centre of Iran. (2019). Results of the research project of access and use of households and individuals to information and communication technology 2017. [in Persian]
Taheri Khoinrood, Z. (2018). Identifying the effective factors in the use of eighth grade students in Tabriz from the Iranian search engine "Parsijoo": A case study. Unpublished master’s thesis. University of Tabriz. [in Persian]
Tawileh, W., Mandl, T., Griesbaum, J., Atzmueller, M., Benz, D., Hotho, A., & Stumme, G. (2010). Evaluation of five web search engines in Arabic language. In LWA (pp. 221-228).
Taylor, G. (2013). Search quality and revenue cannibalization by competing search engines. Journal of Economics & Management Strategy, 22(3), 445-467. https://doi.org/10.1111/jems.12027
UNICEF. (2018, February 6). More than 175,000 children go online for the first time every day, tapping into great opportunities, but facing grave risks. Retrieved from https://www.unicef.org/bangladesh/en/press-releases/more-175000-children-go-online-first-time-every-day-tapping-great-opportunities
UNICEF. (2019, September 17). Protracted conflict, the climate crisis, a rise in mental illness and online misinformation among biggest emerging threats to children. https://www.unicef.org/bangladesh/en/press-releases/protracted-conflict-climate-crisis-rise-mental-illness-and-online-misinformation
Wilson, L. (2019). Making your content work harder. in Data-driven marketing content (pp. 119-132). Bingley: Emerald Publishing Limited.
Yakovliev, M. & Filonenko, K. (2019). Effects of loading speed on the site traffic conversion. Системи управління, навігації та зв’язку. Збірник наукових праць, 5(57), 92-94. Retrieved from https://www.semanticscholar.org/reader/7cb3067557578f52be73a48224b900601fb29381
Zeynali Tazehkandi, M. & Nowkarizi, M. (2020). Evaluating the effectiveness of Google, Parsijoo, Rismoon, and Yooz to retrieve Persian documents. Library Hi Tech, 39(1), 166-189. https://doi.org/10.1108/LHT-11-2019-0229
Zhang, J., Fei, W. & Le, T. (2013). A comparative analysis of the search feature effectiveness of the major English and Chinese search engines. Online Information Review, 37(2), 217-230. https://doi.org/10.1108/OIR-07-2011-0099
Zhang, R., Xie, X., Mao, J., Liu, Y., Zhang, M. & Ma, S. (2021, April). Constructing a comparison-based click model for web search. In Proceedings of the Web Conference 2021 (pp. 270-283). https://doi.org/10.1145/3442381.3449918
Zhu, Q., Du, J. T., Meng, F., Wu, K., & Sun, X. (2011). Using a Delphi method and the analytic hierarchy process to evaluate Chinese search engines: A case study on Chinese search engines. Online Information Review, 35(6), 942-956. https://doi.org/10.1108/14684521111193210
Ziakis, C., Vlachopoulou, M., Kyrkoudis, T. & Karagkiozidou, M. (2019). Important factors for improving Google search rank. Future Internet, 11(2), 32. https://doi.org/10.3390/fi11020032
', './data/ijism/coversheet/cover_en.jpg'))