Document Type : Research Paper

Authors

1 Shahid Chamran University of Ahvaz, Ahvaz, Iran

2 Islamic Azad University, North Branch, Tehran

Abstract

This mixed-methods study sought to examine any significant impact of Iranian English as a Foreign Language (EFL) teachers' collaboration in rating speaking tests and brainstorming theoretical concepts of language assessment (LA) on their literacy, perceptions, and practices of speaking assessment. Forty-one Iranian EFL teachers selected through purposeful sampling were asked to fill out a questionnaire, including 20 components of LA, so as to measure their knowledge and perceptions of LA components. Then, 21 of the teachers volunteered to score the video-projected speaking performance of 12 international students in the Key English Test (KET) using KET speaking rating scales. Having received six in-service speaking assessment training sessions based on their collaboration, the 21 participating teachers completed the same questionnaire and scored the same videos again. An ANCOVA was used to compare the quantitative data from the questionnaire and teachers’ scoring of KET speaking tests before and after the treatment and also to investigate any significant differences between the novice and experienced Iranian EFL teachers in terms of their knowledge and perception of LA, and the assessment of KET speaking tests. Moreover, the 21 volunteered teachers were interviewed to further discover their perceptions about the in-service speaking assessment training course they attended. The findings revealed that the collaboration of the Iranian EFL teachers in rating speaking tests and brainstorming theoretical concepts of LA significantly impacted their knowledge, perceptions, and practices of LA. However, the effects were unequal and different for novice and experienced EFL teachers.

Keywords

Main Subjects

The authors declare that there were no conflicts of interest and received no funding for this study.

 
Adie, L. (2013). The development of teacher assessment identity through participation in online moderation. Assessment in Education: Principles, Policy & Practice20(1), 91-106.
Ahmadi, A. (2019). A Study of Raters’ Behavior in Scoring L2 Speaking Performance: Using Rater Discussion as a Training Tool. Issues in Language Teaching8(1), 195-224.
Alderson, J. C., & Clapham, C. (1995). Assessing student performance in the ESL classroom. Tesol Quarterly29(1), 184-187.
Allal, L. (2013). Teachers’ professional judgment in assessment: A cognitive act and a socially situated practice. Assessment in Education: Principles, Policy & Practice20(1), 20-34.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests (Vol. 1). Oxford University Press.
Baker, B. A., & Riches, C. (2018). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing35(4), 557-581.
Bangert, A., & Kelting-Gibson, L. (2007). Teaching principles of assessment literacy through teacher work sample methodology. Tep Vol 19-N3, 351.
Berry, V., Sheehan, S., & Munro, S. (2019). What does language assessment literacy mean to teachers? ELT Journal73(2), 113-123.
Bijani, H. (2019). Evaluating the effectiveness of the training program on direct and semi-direct oral proficiency assessment: A case of multifaceted Rasch analysis. Cogent Education6(1), 1670592.
Bijani, H., & Khabiri, M. (2017). The impact of raters’ and test takers’ gender on oral proficiency assessment: A case of multifaceted Rasch analysis. Teaching English as a Second Language36(3), 1-32.
Cheng, L., & Wang, X. (2007). Grading, feedback, and reporting in ESL/EFL classrooms. Language Assessment Quarterly4(1), 85-107.
Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Language assessment literacy: what do we need to learn, unlearn, and relearn? Language Testing in Asia10, 1-16.
Davies, A. (2008). Textbook trends in teaching language testing. Language testing25(3), 327-347.
DeLuca, C., & Bellara, A. (2013). The current state of assessment education: Aligning policy, standards, and teacher education curriculum. Journal of Teacher Education64(4), 356-372.
DeLuca, C., Klinger, D., Pyper, J., & Woods, J. (2015). Instructional rounds as a professional learning model for systemic implementation of assessment for learning. Assessment in education: principles, policy & practice22(1), 122-139.
Farhady, H., & Tavassoli, K. (2018). Developing a language assessment knowledge test for EFL teachers: A data-driven approach. Iranian Journal of Language Teaching Research6(3), 79-94.
Firoozi, T., Razavipour, K., & Ahmadi, A. (2019). The language assessment literacy needs of Iranian EFL teachers with a focus on reformed assessment policies. Language Testing in Asia9(1), 1-14.
Fulcher, G. (2003). Testing second language speaking. Pearson Education.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly9(2), 113-132.
Giraldo, F. (2019). Language assessment practices and beliefs: Implications for language assessment literacy. How26(1), 35-61.
Gotwals, A. W., & Birmingham, D. (2016). Eliciting, identifying, interpreting, and responding to students’ ideas: Teacher candidates’ growth in formative assessment practices. Research in Science Education46(3), 365-388.
Gu, L. (2015). Language ability of young English language learners: Definition, configuration, and implications. Language Testing32(1), 21-38.
Han, Q. (2016). Rater cognition in L2 speaking assessment: A review of the literature. Teachers College, Columbia University Working Papers in TESOL & Applied Linguistics, 16(1), 1-24.
Herrera Mosquera, L., & Macías V, D. F. (2015). A call for language assessment literacy in the education and development of teachers of English as a foreign language. Colombian Applied Linguistics Journal17(2), 302-312.
Homayounzadeh, Z., & Razmjoo, S. A. (2021). Examining assessment literacy in practice in an Iranian context: Does it differ for instructors and learners? Teaching English as a Second Language40(2), 1-45.
Inbar-Lourie, O. (2008). Language assessment culture. Encyclopedia of language and education7, 285-300.
Inbar-Lourie, O. (2012). Language assessment literacy. In C. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1-9). John Wiley & Sons.
Jonsson, A., Lundahl, C., & Holmgren, A. (2015). Evaluating a large-scale implementation of Assessment for Learning in Sweden. Assessment in education: Principles, policy & practice22(1), 104-121.
Kim, A. A., Chapman, M., Kondo, A., & Wilmes, C. (2020). Examining the assessment literacy required for interpreting score reports: A focus on educators of K–12 English learners. Language Testing37(1), 54-75.
Koh, K. H. (2011). Improving teachers’ assessment literacy through professional development. Teaching Education22(3), 255-276.
Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly17(1), 100-120.
Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing32(2), 169-197.
Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy for in-service EFL teachers: The gaps. Studies in Educational Evaluation61, 112-122.
Looney, A., Cumming, J., van Der Kleij, F., & Harris, K. (2018). Reconceptualizing the role of teachers as assessors: teacher assessment identity. Assessment in Education: Principles, Policy & Practice25(5), 442-467.
López Mendoza, A. A., & Bernal Arandia, R. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile: Issues in Teachers Professional Development11(2), 55-70.
Luoma, S. (2004). Assessing speaking. Cambridge: Cambridge University Press.
Malone, M. E. (2008). Training in language assessment. Encyclopedia of language and education7, 225-239.
Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing30(3), 329-344.
Mertler, C. A. (2009). Teachers' assessment knowledge and their perceptions of the impact of classroom assessment professional development. Improving schools12(2), 101-113.
Nowruzi, M., & Amerian, M. (2020). Exploring the factors Iranian EFL institute teachers consider in grading using personal construct theory. Journal of Teaching Language Skills38(4), 123-164.
Orr, M. (2002). The FCE speaking test: Using rater reports to help interpret test scores. System30(2), 143-154.
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into practice48(1), 4-11.
Popham, W. J. (2013). Classroom assessment: What teachers need to know (7th ed.). Boston, MA: Pearson.
Rashvand Semiyari, S., & Ahangari, S. (2019). The Impact of Task Types and Rating Methods on Iranian EFL Learners’ Speaking Scores. Research in English Language Pedagogy7(2), 187-208.
Sato, M., Wei, R. C., & Darling-Hammond, L. (2008). Improving teachers’ assessment practices through professional development: The case of National Board Certification. American Educational Research Journal45(3), 669-700.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing30(3), 309-327.
Stiggins, R. (2007). Assessment through the student's eyes. Educational leadership64(8), 22.
Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan72(7), 534-539.
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language testing30(3), 403-412.
Tsagari, D., & Vogt, K. (2017). Assessment literacy of foreign language teachers around Europe: Research, challenges and future prospects. Papers in Language Testing and Assessment6(1), 41-63.
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly11(4), 374-402.
Volante, L., & Fazio, X. (2007). Exploring Teacher Candidates' Assessment Literacy: Implications for Teacher Education Reform and Professional Development. Canadian Journal of Education30(3), 749-770.
Watmani, R., Asadollahfam, H., & Behin, B. (2020). Demystifying language assessment literacy among high school teachers of English as a foreign language in Iran: Implications for teacher education reforms. International Journal of Language Testing10(2), 129-144.
Wiliam, D., & Thompson, M. (2007). Integrating assessment with instruction: What will it take to make it work? In C. A. Dwyer (Ed.), The future of assessment: Shaping teaching and learning (pp. 53–82). Lawrence Erlbaum Associates.
Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education58, 149-162.