Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills)

The Impact of Collaborative In-service Training on EFL Teachers’ Language Assessment Literacy, Perceptions and Practices

Document Type : Research Paper

Authors

1 Shahid Chamran University of Ahvaz, Ahvaz, Iran

2 Islamic Azad University, North Branch, Tehran

Abstract

This mixed-methods study sought to examine any significant impact of Iranian English as a Foreign Language (EFL) teachers' collaboration in rating speaking tests and brainstorming theoretical concepts of language assessment (LA) on their literacy, perceptions, and practices of speaking assessment. Forty-one Iranian EFL teachers selected through purposeful sampling were asked to fill out a questionnaire, including 20 components of LA, so as to measure their knowledge and perceptions of LA components. Then, 21 of the teachers volunteered to score the video-projected speaking performance of 12 international students in the Key English Test (KET) using KET speaking rating scales. Having received six in-service speaking assessment training sessions based on their collaboration, the 21 participating teachers completed the same questionnaire and scored the same videos again. An ANCOVA was used to compare the quantitative data from the questionnaire and teachers’ scoring of KET speaking tests before and after the treatment and also to investigate any significant differences between the novice and experienced Iranian EFL teachers in terms of their knowledge and perception of LA, and the assessment of KET speaking tests. Moreover, the 21 volunteered teachers were interviewed to further discover their perceptions about the in-service speaking assessment training course they attended. The findings revealed that the collaboration of the Iranian EFL teachers in rating speaking tests and brainstorming theoretical concepts of LA significantly impacted their knowledge, perceptions, and practices of LA. However, the effects were unequal and different for novice and experienced EFL teachers.

Keywords

Main Subjects

The authors declare that there were no conflicts of interest and received no funding for this study.

References
 
Adie, L. (2013). The development of teacher assessment identity through participation in online moderation. Assessment in Education: Principles, Policy & Practice, 20(1), 91-106.
Ahmadi, A. (2019). A Study of Raters’ Behavior in Scoring L2 Speaking Performance: Using Rater Discussion as a Training Tool. Issues in Language Teaching, 8(1), 195-224.
Alderson, J. C., & Clapham, C. (1995). Assessing student performance in the ESL classroom. Tesol Quarterly, 29(1), 184-187.
Allal, L. (2013). Teachers’ professional judgment in assessment: A cognitive act and a socially situated practice. Assessment in Education: Principles, Policy & Practice, 20(1), 20-34.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests (Vol. 1). Oxford University Press.
Baker, B. A., & Riches, C. (2018). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing, 35(4), 557-581.
Bangert, A., & Kelting-Gibson, L. (2007). Teaching principles of assessment literacy through teacher work sample methodology. Tep Vol 19-N3, 351.
Berry, V., Sheehan, S., & Munro, S. (2019). What does language assessment literacy mean to teachers? ELT Journal, 73(2), 113-123.
Bijani, H. (2019). Evaluating the effectiveness of the training program on direct and semi-direct oral proficiency assessment: A case of multifaceted Rasch analysis. Cogent Education, 6(1), 1670592.
Bijani, H., & Khabiri, M. (2017). The impact of raters’ and test takers’ gender on oral proficiency assessment: A case of multifaceted Rasch analysis. Teaching English as a Second Language, 36(3), 1-32.
Cheng, L., & Wang, X. (2007). Grading, feedback, and reporting in ESL/EFL classrooms. Language Assessment Quarterly, 4(1), 85-107.
Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Language assessment literacy: what do we need to learn, unlearn, and relearn? Language Testing in Asia, 10, 1-16.
Davies, A. (2008). Textbook trends in teaching language testing. Language testing, 25(3), 327-347.
DeLuca, C., & Bellara, A. (2013). The current state of assessment education: Aligning policy, standards, and teacher education curriculum. Journal of Teacher Education, 64(4), 356-372.
DeLuca, C., Klinger, D., Pyper, J., & Woods, J. (2015). Instructional rounds as a professional learning model for systemic implementation of assessment for learning. Assessment in education: principles, policy & practice, 22(1), 122-139.
Farhady, H., & Tavassoli, K. (2018). Developing a language assessment knowledge test for EFL teachers: A data-driven approach. Iranian Journal of Language Teaching Research, 6(3), 79-94.
Firoozi, T., Razavipour, K., & Ahmadi, A. (2019). The language assessment literacy needs of Iranian EFL teachers with a focus on reformed assessment policies. Language Testing in Asia, 9(1), 1-14.
Fulcher, G. (2003). Testing second language speaking. Pearson Education.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132.
Giraldo, F. (2019). Language assessment practices and beliefs: Implications for language assessment literacy. How, 26(1), 35-61.
Gotwals, A. W., & Birmingham, D. (2016). Eliciting, identifying, interpreting, and responding to students’ ideas: Teacher candidates’ growth in formative assessment practices. Research in Science Education, 46(3), 365-388.
Gu, L. (2015). Language ability of young English language learners: Definition, configuration, and implications. Language Testing, 32(1), 21-38.
Han, Q. (2016). Rater cognition in L2 speaking assessment: A review of the literature. Teachers College, Columbia University Working Papers in TESOL & Applied Linguistics, 16(1), 1-24.
Herrera Mosquera, L., & Macías V, D. F. (2015). A call for language assessment literacy in the education and development of teachers of English as a foreign language. Colombian Applied Linguistics Journal, 17(2), 302-312.
Homayounzadeh, Z., & Razmjoo, S. A. (2021). Examining assessment literacy in practice in an Iranian context: Does it differ for instructors and learners? Teaching English as a Second Language, 40(2), 1-45.
Inbar-Lourie, O. (2008). Language assessment culture. Encyclopedia of language and education, 7, 285-300.
Inbar-Lourie, O. (2012). Language assessment literacy. In C. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1-9). John Wiley & Sons.
Jonsson, A., Lundahl, C., & Holmgren, A. (2015). Evaluating a large-scale implementation of Assessment for Learning in Sweden. Assessment in education: Principles, policy & practice, 22(1), 104-121.
Kim, A. A., Chapman, M., Kondo, A., & Wilmes, C. (2020). Examining the assessment literacy required for interpreting score reports: A focus on educators of K–12 English learners. Language Testing, 37(1), 54-75.
Koh, K. H. (2011). Improving teachers’ assessment literacy through professional development. Teaching Education, 22(3), 255-276.
Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100-120.
Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169-197.
Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy for in-service EFL teachers: The gaps. Studies in Educational Evaluation, 61, 112-122.
Looney, A., Cumming, J., van Der Kleij, F., & Harris, K. (2018). Reconceptualizing the role of teachers as assessors: teacher assessment identity. Assessment in Education: Principles, Policy & Practice, 25(5), 442-467.
López Mendoza, A. A., & Bernal Arandia, R. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile: Issues in Teachers Professional Development, 11(2), 55-70.
Luoma, S. (2004). Assessing speaking. Cambridge: Cambridge University Press.
Malone, M. E. (2008). Training in language assessment. Encyclopedia of language and education, 7, 225-239.
Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329-344.
Mertler, C. A. (2009). Teachers' assessment knowledge and their perceptions of the impact of classroom assessment professional development. Improving schools, 12(2), 101-113.
Nowruzi, M., & Amerian, M. (2020). Exploring the factors Iranian EFL institute teachers consider in grading using personal construct theory. Journal of Teaching Language Skills, 38(4), 123-164.
Orr, M. (2002). The FCE speaking test: Using rater reports to help interpret test scores. System, 30(2), 143-154.
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into practice, 48(1), 4-11.
Popham, W. J. (2013). Classroom assessment: What teachers need to know (7th ed.). Boston, MA: Pearson.
Rashvand Semiyari, S., & Ahangari, S. (2019). The Impact of Task Types and Rating Methods on Iranian EFL Learners’ Speaking Scores. Research in English Language Pedagogy, 7(2), 187-208.
Sato, M., Wei, R. C., & Darling-Hammond, L. (2008). Improving teachers’ assessment practices through professional development: The case of National Board Certification. American Educational Research Journal, 45(3), 669-700.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309-327.
Stiggins, R. (2007). Assessment through the student's eyes. Educational leadership, 64(8), 22.
Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534-539.
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language testing, 30(3), 403-412.
Tsagari, D., & Vogt, K. (2017). Assessment literacy of foreign language teachers around Europe: Research, challenges and future prospects. Papers in Language Testing and Assessment, 6(1), 41-63.
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374-402.
Volante, L., & Fazio, X. (2007). Exploring Teacher Candidates' Assessment Literacy: Implications for Teacher Education Reform and Professional Development. Canadian Journal of Education, 30(3), 749-770.
Watmani, R., Asadollahfam, H., & Behin, B. (2020). Demystifying language assessment literacy among high school teachers of English as a foreign language in Iran: Implications for teacher education reforms. International Journal of Language Testing, 10(2), 129-144.
Wiliam, D., & Thompson, M. (2007). Integrating assessment with instruction: What will it take to make it work? In C. A. Dwyer (Ed.), The future of assessment: Shaping teaching and learning (pp. 53–82). Lawrence Erlbaum Associates.
Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162.
Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills)
Volume 41, Issue 3
August 2022
Pages 89-115
Files
History
  • Receive Date: 23 February 2022
  • Revise Date: 26 May 2022
  • Accept Date: 07 June 2022
Share
How to cite
Statistics