Investigating Iranian EFL Teacher AI Assessment Literacy: A ChatGPT-Driven Collaborative Reflective Approach

Document Type : Research Paper

Authors

Department of English Language Teaching, Faculty of Literature and Humanities, Imam Khomeini International University, Qazvin, Iran

Abstract

The emergence of artificial intelligence (AI) has prompted teachers to integrate AI tools into assessment practices. Accordingly, teachers need to learn how to implement AI tools to inform their assessment practices with a sufficient level of AI-based assessment literacy. One promising approach to developing teachers' AI-based assessment literacy can be collaborative reflective practice (CRP), particularly when facilitated by tools such as ChatGPT or other generative AI technologies. This study qualitatively explored how English-as-a-foreign-language (EFL) teachers can reflect and collaborate with ChatGPT, individually and collectively, through CRP to develop their AI-based assessment literacy. After collecting qualitative data from six novice and experienced EFL teachers through observations, group discussions, and interviews within a descriptive case research design, we found that EFL teachers developed their AI-based assessment literacy emotionally, socially, and professionally through ChatGPT-driven CRP. Teachers reflected on their AI-based assessment practices, collaborated with ChatGPT to identify and solve problems related to using AI tools in assessment, received feedback and guidance from ChatGPT on using AI tools in their assessment practices, and improved their knowledge of AI-based assessment through ChatGPT-driven CRP. The findings contribute to the growing dialogue on AI integration in professional development by empirically showing that ChatGPT-driven collaborative reflective practice can serve as a viable, accessible, and context-responsive mechanism for developing EFL teachers' AI-based assessment literacy, particularly in under-resourced contexts where institutional professional development opportunities are limited.

Keywords

Main Subjects

References

Afshar, H. S., & Doosti, M. (2022). Implementing and evaluating a peer-coached EFL teacher professional development program. Evaluation and Program Planning, 92, 102096. https://doi.org/10.1016/j.evalprogplan.2022.102096
Al-Khresheh, M. H. (2024). Bridging technology and pedagogy from a global lens: Teachers' perspectives on integrating ChatGPT in English language teaching. Computers and Education: Artificial Intelligence, 6, 100218. https://doi.org/10.1016/j.caeai.2024.100218
Alharbi, W. (2023). AI in the foreign language classroom: A pedagogical overview of automated writing assistance tools. Education Research International, 2023(1), 4253331. https://doi.org/10.1155/2023/4253331
Almatrafi, O., Johri, A., & Lee, H. (2024). A Systematic Review of AI Literacy   Conceptualization, Constructs, and Implementation and Assessment Efforts (2019-2023). Computers and Education Open, 100173. https://doi.org/10.1016/j.caeo.2024.100173
Bennett, S. V., Brown Jr., J. J., Kirby-Smith, A., & Severson, B. (2013). Influences of the heart: Novice and experienced teachers remaining in the field. Teacher Development, 17(4), 562–576. https://doi.org/10.1080/13664530.2013.849613
Bower, M., Torrington, J., Lai, J. W., Petocz, P., & Alfano, M. (2024). How should we change teaching and assessment in response to increasingly powerful generative Artificial Intelligence? Outcomes of the ChatGPT teacher survey. Education and Information Technologies, 1–37. https://doi.org/10.1007/s10639-023-12405-0
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.
Celik, I. (2023). Towards intelligent-TPACK: An empirical study on teachers' professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, 107468. https://doi.org/10.1016/j.chb.2022.107468
Brown, J. D., & Hudson, T. (1998). The alternatives in language assessment. TESOL Quarterly, 32(4), 653–675. https://doi.org/10.2307/3587999
Dakakni, D., & Safa, N. (2023). Artificial intelligence in the L2 classroom: Implications and challenges on ethics and equity in higher education: A 21st-century Pandora's box. Computers and Education: Artificial Intelligence, 5, 100179. https://doi.org/10.1016/j.caeai.2023.100179
Deng, J., & Lin, Y. (2022). The benefits and challenges of ChatGPT: An overview. Frontiers in Computing and Intelligent Systems, 2(2), 81–83. https://doi.org/10.54097/fcis.v2i2.4465
Dimitriadou, E., & Lanitis, A. (2023). A critical evaluation, challenges, and future perspectives of using artificial intelligence and emerging technologies in smart classrooms. Smart Learning Environments, 10(1), 12. https://doi.org/10.1186/s40561-023-00231-3
Ding, A. C. E., Shi, L., Yang, H., & Choi, I. (2024). Enhancing teacher AI literacy and integration through different types of cases in teacher professional development. Computers and Education Open, 6, 100178. https://doi.org/10.1016/j.caeo.2024.100178
Du, Y., & Gao, H. (2022). Determinants affecting teachers' adoption of AI-based applications in EFL context: An analysis of analytic hierarchy process. Education and Information Technologies, 27(7), 9357–9384. https://doi.org/10.1007/s10639-022-11001-y
Fang, Y., Roscoe, R. D., & McNamara, D. S. (2023). Artificial intelligence-based assessment in education. In Handbook of artificial intelligence in education (pp. 485- 504). Edward Elgar Publishing. https://doi.org/10.4337/9781800375413.00033
Gao, R., Liu, J., & Yin, B. (2021). An expanded ethical decision-making model to resolve ethical dilemmas in assessment. Studies in Educational Evaluation, 68, 100978. https://doi.org/10.1016/j.stueduc.2021.100978
Gill, S. S., Xu, M., Patros, P., Wu, H., Kaur, R., Kaur, K., ... & Buyya, R. (2024). Transformative effects of ChatGPT on modern education: Emerging Era of AI Chatbots. Internet of Things and Cyber-Physical Systems, 4, 19–23.        https://doi.org/10.1016/j.iotcps.2023.06.002
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied sciences, 11(12), 5467.
https://doi.org/10.3390/app11125467
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial intelligence for assessment and feedback to enhance student success in higher education. Mathematical Problems in Engineering, 2022(1), 5215722. https://doi.org/10.1155/2022/5215722
Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, research issues, and applications of artificial intelligence in language education. Educational Technology & Society, 26(1), 112–131.
Jeon, J., & Lee, S. (2023). Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT. Education and Information Technologies, 28(12), 15873–15892. https://doi.org/10.1007/s10639-023-11834-1
Jiang, R. (2022). How does artificial intelligence empower EFL teaching and learning nowadays? A review on artificial intelligence in the EFL context. Frontiers in Psychology, 13, 1049401. https://doi.org/10.3389/fpsyg.2022.1049401
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... &    Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274.
https://doi.org/10.1016/j.lindif.2023.102274
Kemmis, S., McTaggart, R., & Nixon, R. (2013). The action research planner: Doing critical participatory action research. Springer Science & Business Media.
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. Relc Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868
Koraishi, O. (2023). Teaching English in the age of AI: Embracing ChatGPT to optimize EFL materials and assessment. Language Education and Technology Journal, 3(1).
Lisnawati, S. D., & Muharam, S. (2023). Teacher Professionalism Development Strategy through ChatGPT Support in the Context of Education Management. Journal of Contemporary Administration and Management (ADMAN), 1(3), 150–155.
Little, D. (2006). The Common European Framework of Reference for Languages: Content, purpose, origin, reception and impact. Language Teaching, 39(3), 167–190.
https://doi.org/10.1017/S0261444806003557
Liu, J. (2024). ChatGPT: perspectives from human–computer interaction and psychology. Frontiers in Artificial Intelligence, 7, 1418869. https://doi.org/10.3389/frai.2024.1418869
Loughran, J. J. (2002). Effective reflective practice: In search of meaning in learning about teaching. Journal of Teacher Education, 53(1), 33–43.
https://doi.org/10.1177/0022487102053001004
Cukurova, M., & Miao, F. (2024). AI competency framework for teachers. UNESCO Publishing.
Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A    framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054.
https://doi.org/10.1111/j.1467-9620.2006.00684.x
Morris, R., Perry, T., & Wardle, L. (2021). Formative assessment and feedback for learning in higher education: A systematic review. Review of Education, 9(3), e3292. https://doi.org/10.1002/rev3.3292
Popenici, S. A., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and practice in technology enhanced      learning, 12(1), 22. https://doi.org/10.1186/s41039-017-0062-8
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., ... & Jinks, C. (2018). Saturation in qualitative research: exploring its conceptualization and operationalization. Quality & Quantity, 52(4), 1893–1907.        https://doi.org/10.1007/s11135-017-0574-8
Şener, B., & Mede, E. (2023). Promoting learner autonomy and improving reflective thinking skills through reflective practice and collaborative learning. Innovation in Language Learning and Teaching, 17(2), 364–379. https://doi.org/10.1080/17501229.2022.2047694
Sidorkin, A. M. (2024). Embracing chatbots in higher education: the use of artificial intelligence in teaching, administration, and scholarship. Taylor & Francis.
Sperling, K., Stenberg, C. J., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024). In search of artificial intelligence (AI) literacy in Teacher Education: A scoping review. Computers and Education Open, 100169. https://doi.org/10.1016/j.caeo.2024.100169
Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162.
     https://doi.org/10.1016/j.tate.2016.05.010
Wang, Y., Pan, Y., Yan, M., Su, Z., & Luan, T. H. (2023). A survey on ChatGPT: AI-generated content, challenges, and solutions. IEEE Open Journal of the Computer Society.
Teaching English as a Second Language Quarterly
Volume 45, Issue 4
September 2026
Pages 29-53

Files

History

  • Receive Date: 16 April 2026
  • Revise Date: 27 June 2026
  • Accept Date: 08 August 2026

Share

How to cite

Statistics