Document Type : Articles


Tabriz University of Medical Sciences


Due to limited time, physicians often find it challenging to find the exact answers to their questions among search engine results; however, question and answer (Q&A) systems can facilitate more rapidly identify accurate solutions. This study aims to develop and evaluate a Q&A system for physicians at Tabriz University of Medical Sciences. Four clinical and informatics experts and the two health information managers agreed on 19 features and themes throughout two focus group meetings. Subsequently, a system was developed on a MySQL database using the PHP web development language and then uploaded to the web. Finally, the system was opened up to 40 users and, over three months, evaluated using a community evaluation questionnaire and the six-dimension Users’ Experience Questionnaire. The focus group results in determining the features of the Q&A system consisted of 19 requirements. The average attractiveness, perspicuity, efficiency, dependability, stimulation, and novelty were equal to 1.76, 1.625, 1.9, 1.425, 1.475, and 1.375, respectively. The Q&A system improved the tasks such as share of knowledge, transfer of information, social partnership, and cooperation among users. The physicians were able to obtain the information they required through contact with their co-practitioners over the system.


  1. Agichtein, E., Castillo, C., Donato, D., Gionis, A., & Mishne, G. (2008). Finding high-quality content in social media. Paper presented at the Proceedings of the 2008 international conference on web search and data mining.
  2. Buğra, Z., & Işıl Günseli, K. (2015). Google Search Applications in Foreign Language Classes at Tertiary Level: A Case Study in the Turkish Context. In T. Vehbi (Ed.), Intelligent Design of Interactive Multimedia Listening Software (pp. 313-356). Hershey, PA, USA: IGI Global.
  3. Carroll, A. R. (2015). Exploring the effects of multimedia content on a question and answer system. Clemson University,
  4. Cota, M. P., Thomaschewski, J., Schrepp, M., & Gonçalves, R. (2014). Efficient measurement of the user experience. A Portuguese version. Procedia Computer Science, 27, 491-498.
  5. Diana, N. E., & Saputra, O. A. (2015). Measuring user experience of a potential shipment tracking application. Paper presented at the Proceedings of the International HCI and UX Conference in Indonesia.
  6. Dunning, J., Prendergast, B., & Mackway-Jones, K. (2003). Towards evidence-based medicine in cardiothoracic surgery: best BETS. Interactive cardiovascular and thoracic surgery, 2(4), 405-409.
  7. Eliote, S. (2015). Guidelines for Conducting a Focus Group. Retrieved from
  8. Ely, J. W., Osheroff, J. A., Chambliss, M. L., Ebell, M. H., & Rosenbaum, M. E. (2005). Answering physicians' clinical questions: obstacles and potential solutions. Journal of the American Medical Informatics Association, 12(2), 217-224.
  9. Initiative, S. N. M. H. (2014). Patient-Centered Medical Home Forum Evaluation Form. Retrieved from
  10. Kahn, J. G., Yang, J. S., & Kahn, J. S. (2010). ‘Mobile’health needs and opportunities in developing countries. Health Affairs, 29(2), 252-258.
  11. Kim, S., & Oh, S. (2009). Users' relevance criteria for evaluating answers in a social Q&A site. Journal of the Association for Information Science and Technology, 60(4), 716-727.
  12. Koh, J., & Kim, Y.-G. (2004). Knowledge sharing in virtual communities: an e-business perspective. Expert systems with applications, 26(2), 155-166.
  13. Kosny, A., Smith, P., & Lifshen, M. (2009). Report from the Research and Policy Knowledge Exchange Forum on Immigration, Work and Health
  14. in British Columbi.
  15. Kwahk, K.-Y., & Park, D.-H. (2016). The effects of network sharing on knowledge-sharing activities and job performance in enterprise social media environments. Computers in Human Behavior, 55, 826-839.
  16. Lai, H.-M., & Chen, T. T. (2014). Knowledge sharing in interest online communities: A comparison of posters and lurkers. Computers in Human Behavior, 35, 295-306.
  17. Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. Paper presented at the Symposium of the Austrian HCI and Usability Engineering Group.
  18. Lee, M., Cimino, J., Zhu, H. R., Sable, C., Shanker, V., Ely, J., & Yu, H. (2006). Beyond information retrieval—medical question answering. Paper presented at the AMIA annual symposium proceedings.
  19. Leonardi, P. M. (2017). The social media revolution: Sharing and learning in the age of leaky knowledge. Information and Organization, 27(1), 47-59.
  20. Li, B., Li, R.-H., King, I., Lyu, M. R., & Yu, J. X. (2015). A topic-biased user reputation model in rating systems. Knowledge and Information Systems, 44(3), 581-607.
  21. Lin, M.-J. J., Hung, S.-W., & Chen, C.-J. (2009). Fostering the determinants of knowledge sharing in professional virtual communities. Computers in Human Behavior, 25(4), 929-939.
  22. Liu, Y., Bian, J., & Agichtein, E. (2008). Predicting information seeker satisfaction in community question answering. Paper presented at the Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval.
  23. Maijala, R., Anttila, M., Koivunen, M., Pitkänen, A., Kuosmanen, L., & Välimäki, M. (2015). Internet delivered question and answer column for patients with schizophrenia. Informatics for Health and Social Care, 40(3), 267-278.
  24. Murphy, S. N., Weber, G., Mendis, M., Gainer, V., Chueh, H. C., Churchill, S., & Kohane, I. (2010). Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2). J Am Med Inform Assoc, 17(2), 124-130. doi:10.1136/jamia.2009.000893
  25. Pera, M. S., & Ng, Y.-K. (2011). A community question-answering refinement system. Paper presented at the Proceedings of the 22nd ACM conference on Hypertext and hypermedia.
  26. Rauschenberger, M., Schrepp, M., Cota, M. P., Olschner, S., & Thomaschewski, J. (2013). Efficient measurement of the user experience of interactive products. How to use the user experience questionnaire (ueq). Example: spanish language version. International Journal of Artificial Intelligence and Interactive Multimedia. 2013; 2 (1): 39-45.
  27. Richardson, W. S., Wilson, M. C., Nishikawa, J., & Hayward, R. S. (1995). The well-built clinical question: a key to evidence-based decisions. ACP journal club, 123(3), A12-A12.
  28. Santosa, P. I. (2016). Measuring User Experience During a Web-based Survey: A Case of Back-to-Back Online Surveys. International Journal on Advanced Science, Engineering and Information Technology, 6(3), 339-344.
  29. Santoso, H. B., Fadhilah, S., Nurrohmah, I., & Goodridge, W. H. (2016). The usability and user experience evaluation of web-based online self-monitoring tool: Case study human-computer interaction course. Paper presented at the User Science and Engineering (i-USEr), 2016 4th International Conference on.
  30. Santoso, H. B., Schrepp, M., Isal, R., Utomo, A. Y., & Priyogi, B. (2016). Measuring User Experience of the Student-Centered e-Learning Environment. Journal of Educators Online, 13(1), 58-79.
  31. Schrepp, M., Hinderks, A., & Thomaschewski, J. (2014). Applying the User Experience Questionnaire (UEQ) in different evaluation scenarios. Paper presented at the International Conference of Design, User Experience, and Usability.
  32. Surowiecki, J., & Silverman, M. P. (2007). The wisdom of crowds. American Journal of Physics, 75(2), 190-192.
  33. Vinker, S., Weinfass, M., Kasinetz, L. M., Kitai, E., & Kaiserman, I. (2007). Web-based question-answering service of a family physician—the characteristics of queries in a non-commercial open forum. Medical informatics and the Internet in medicine, 32(2), 123-129.
  34. Zengin, B. (2009). Benefit of Google search engine in learning and teaching collocations. Eurasian Journal of Educational Research (EJER)(34).