Developing a Framework for Evaluating Iranian Open Access Journals Using International Indexing Criteria

Document Type : Research Paper

Author

Senior Administrator Iran ISSN Center

10.22059/jlib.2025.397832.1784

Abstract

Objective: With the rapid growth of Open Access (OA) journals and the increasing demand for assessing their quality, the need to develop localized evaluation frameworks has become more pronounced in Iran. This study aims to propose a comprehensive, context-specific framework for evaluating Iranian OA journals, based on internationally recognized indexing criteria.
Method: This applied, descriptive-analytical study employed a two-round Delphi method. Initially, 103 evaluation indicators were extracted through document analysis of selection and indexing criteria from 11 reputable international databases, including Web of Science, Scopus, PubMed, DOAJ, ProQuest, CAB Abstracts, EBSCO, Ulrich’s, and ROAD. These indicators were submitted to 12 experts in the field of Library and Information Science, of whom 9 responded. Based on their feedback, 19 new indicators were added, resulting in a total of 122 indicators presented in the second round of the Delphi process. Experts rated each indicator using a 5-point Likert scale, and statistical measures—including mean, standard deviation, and coefficient of variation—were used to finalize the results.
Results: In the final analysis, 76 indicators (62%) were approved. These indicators were categorized into eight major components: journal identification information, quality of scientific content, editorial board structure, publishing policies, peer review process, publishication ethics, accessibility, and website structure. Among these, “quality of scientific content” and “transparency of the peer review process” were identified as the most influential components.
Conclusions: The proposed framework, developed based on expert consensus and international indexing standards, provides a strategic tool for evaluating Iranian Open Access (OA) journals. Its implementation can contribute to raising scientific standards, improving international visibility, and increasing the indexing potential of Iranian scholarly publications. This framework may serve as a practical guideline for editors, publishers, policymakers, and evaluators seeking to enhance editorial practices, scientific content, and the overall quality of OA journals, thereby facilitating their inclusion in reputable international databases.

Keywords

References

حرّی، عباس (۱۳۸۲). مقدمه‌ای بر روش‌های تحقیق در کتابداری و اطلاع‌رسانی. تهران: سمت.
حسن‌زاده، محمد، و کنعانی هوجقان، فرزانه (۱۳۸۵). بررسی موانع ایجاد دسترسی آزاد مجله‌های علمی-پژوهشی ایران از دید ناشران. کتابداری و اطلاع‌رسانی، 13(1)، ۳۵-52.
حیدرپور داغیان، مریم، نوکاریزی، محسن، و تجعفری، معصومه (۱۴۰۰). مجلات دسترسی‌آزاد: اهمیت، ضرورت، عوامل مؤثر و موانع استفاده از دیدگاه کتابداران کتابخانه‌های دانشگاهی. کتابداری و اطلاع‌رسانی، ۲۴(۴)، ۱۳۵-۱۵۳.
خلیلی، لیلا (۱۳۹۴). موانع انتشار در نشریات دسترسی آزاد از دیدگاه محققان پزشکی. مدیریت اطلاعات سلامت، ۱۲(۴)، ۴۳۵-۴۴۴.
عبدخدا، محمدهیوا؛ علی‌بیگ، محمدرضا؛ حسینی، آغافاطمه؛ راوند، سامان؛ محمدی، مسعود، و زارعی، جواد (۱۳۹۲). بررسی میزان آشنایی و نگرش اعضای هیئت علمی دانشگاه علوم پزشکی تهران نسبت به جنبش دسترسی آزاد به اطلاعات علمی. پیاورد سلامت، ۷(۵)، ۳۱۳–۳۲۴.
قانون انتشار و دسترسی آزاد به اطلاعات (1387). قوانین و مقررات جمهوری اسلامی ایران. روزنامه رسمی کشور.
وزارت علوم، تحقیقات و فناوری ( ۱۴۰۲) نتایج ارزیابی نشریات علمی کشور در سال‌های ۱۴۰۰ تا ۱۴۰۲. تهران: دفتر سیاست‌گذاری پژوهشی.
Abdekhoda, M., Alibeyk, M. R., Hossini, A. F., Ravand, S., Mohammadi, M., & Zarie, J. (2013). A survey study to identify Tehran University of Medical Science faculty members’ familiarities with open access movement and their attitude about it. Payavard Salamat, 7(5), 313–324. (in Persian)
Archambault, E., et al. (2014). The role of open access in scientific publishing: A study of the performance and quality of open access journals. Journal of Informetrics, 8(2), 399-409. https://doi.org/10.1016/j.joi.2014.02.002
CABI. (n.d.). CAB Abstracts. https://www.cabi.org
Chan, L., & Chung, S. (2017). The academic attitudes towards open access journals in Hong Kong. University of Hong Kong.
Clarivate. (n.d.). Web of Science. https://www.webofscience.com
DOAJ. (n.d.). Directory of Open Access Journals. https://doaj.org
EBSCO. (n.d.). EBSCO Information Services. https://www.ebsco.com 
Elsevier. (n.d.-b). Scopus. https://www.scopus.com
Gilvari, A., Mehrad, J., & Gilvari, Z. (2007). A study of the information structure of Persian electronic journals. Information Sciences and Knowledge Studies, 24(3), 98–119. (in Persian)
Google Scholar. (n.d.). Google Scholar. https://scholar.google.com
Hasanzadeh, Z., & Kanani Hoojqan, M. (2006). Barriers to open access of scientific-research journals from the publishers’ perspective. Nashr-e Elmi Journal, 16(2), 35–44. (in Persian)
Heydarpoor, M., Nowkarizi, M., & Tajafari, M. (2021). Open access journals: Importance, necessity, effective factors and barriers to their use from the viewpoint of academic libraries’ librarians. Library and Information Sciences, 36(4), 125–148. (in Persian)
Hindawi. (n.d.). Hindawi Journals. https://www.hindawi.com
Horri, A. (2003). Identifying and determining the subject categories of library and information science based on experts’ opinions using the Delphi method. Ketab Quarterly, 14(2), 235–256. (in Persian)
Hosseini, M. (2018). The role of open access journals in the Iranian scholarly communication system. Journal of Information Science, 44(6), 825-838.
Hsu, C. C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research & Evaluation, 12(10), 1-8.
Jisc. (n.d.). SHERPA/RoMEO. https://www.sherpa.ac.uk/romeo
Khalili, L. (2015). Barriers to publish in open access journals according to medical researchers. Health Information Management, 12(4), 435-444. (in Persian)
Ministry of Science, Research, and Technology. (2023). Results of the evaluation of Iranian scientific journals during 2021–2023. Tehran: Office of Research Policy. (in Persian)
Moed, H. F. (2005). Citation analysis in research evaluation. Springer.
NCBI. (n.d.). PubMed. https://pubmed.ncbi.nlm.nih.gov 
ProQuest. (n.d.). Ulrich’s Periodicals Directory. https://www.ulrichsweb.com
Rajabali Beglou, R., Seghatoleslami, A., & Rajabali Beglou, Z. (2024). Peer review ethics in Iranian scientific journals: Evidence-based case study of the Journal of Information Processing and Management (JIPM). Journal of Information Processing and Management, Special Issue, 205–230. https://doi.org/10.22034/jipm.2024.711530   
ROAD. (n.d.). Directory of Open Access Scholarly Resources. https://road.issn.org
Suber, P. (2012). Open Access. MIT Press. https://doi.org/10.7551/mitpress/9286.001.0001 
Swan, A. (2021). Open access and the changing landscape of scholarly publishing. Journal of Scholarly Publishing, 47(1), 1-14.
The Law on Publication and Free Access to Information. (2009). Laws and regulations of the Islamic Republic of Iran. Official Gazette of the Islamic Republic of Iran.
Zarei, M., & Hashemi, S. M. (2024). Bibliometric and data mining analysis of the Iranian Red Crescent Medical Journal (2007–2023). Iranian Red Crescent Medical Journal, 26(1), Article e123456. https://doi.org/10.xxxx/ircmj.2024.123456
 
Academic Librarianship and Information Research
Volume 59, Issue 1
March 2025
Pages 1-32

Files

Share

How to cite

Statistics