Document Type : Research Paper
Authors
Shiraz University
Abstract
The study reported here is survey research that aims to examine the assessment literacy (AL) of the instructors (N=12) as well as graduate and postgraduate students (N=46) in the Department of Foreign Languages and Linguistics at Shiraz University. To this end, interview questions were designed using Pastore and Andrade's (2019) three-dimensional AL framework. The questions, having been field-tested and their validity having been approved by three experts, were used to interview the participants. The interviews were transcribed and idea units in them were specified and coded according to a coding scheme designed based on Pastore and Andrade (2019). At the conceptual dimension, the results suggested that most of the participants in both groups believed in the learning potential of assessment, and most of the instructors used multiple tasks throughout the term to gather on the students' learning, especially at the MA and Ph.D. levels. At the praxiological dimension that concerned the integration of assessment with instruction, the students mentioned using the results of summative assessment to alter their studying approach, while only a few instructors used assessment results to modify their teaching practices. At the socio-emotional dimension, discrepancies existed among the instructors and between instructors and learners in how ethical issues should be observed in assessment. The results are discussed, and implications are provided for designing teacher education programs and for future research.
Keywords
Main Subjects
Afsahi, E., Heidari, T., (2017). Iranian EFL teacher's assessment literacy and inclination towards the use of alternative assessment: Journal of Applied Linguistics and Language Research (vol. 4, pp. 283-290).
Ahmadi. A., Mirshojaee.B., (2016). Iranian English language teachers' assessment literacy: The case of public schools and language institute teachers. The Iranian EFL Journal (vol. 12, pp. 6-32).
Ary, D., Jacobs, L. C., Irvine, C. K. S., & Walker, D. (2018). Introduction to Research in Education. Cengage Learning.
Baker, B. A. (2016). Language assessment literacy as professional competence: The case of Canadian admissions decision-makers. Canadian Journal of Applied Linguistics, 19(1), 63-3. https://journals.lib.unb.ca/index.php/CJAL/article/view/23033
Benson, P. (2006). Autonomy in language teaching and learning. Language Teaching, 49(1), 21– 40. https://doi.org/10.1017/s0261444806003958
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5-25.
Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139‐48.
Boud, D. et al. (2010) Assessment 2020: Seven propositions for assessment reform in Higher Education, Sydney: Australian Learning and Teaching Council. Online. Available: <http://www.assessmentfutures.com> (accessed 26/05/19).
Bratchell, N. (1989). Cluster analysis. Chemometrics and Intelligent Laboratory. System, 6, 105–125.
Brookhart, S. (2013). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practice, 30, 3-12.
Brown, J. D., & Bailey, K. (2008). Language testing courses:What are they in 2007? Language Testing, 25(3), 349-383.https://doi.org/10.1177/0265532208090157.
Butler, Y. G., Peng, X., & Lee, J. (2021). Young learners' voices: Towards a learner-centered approach to understanding language assessment literacy. Language Testing, 0265532221992274.
Carless, D., Joughin, G., &Mok, M. (2006). Learning-oriented assessment: principles and practice. Assessment and evaluation in Higher Education, 31(4), 395-398.
Carless, D., &Boud, D. (2018). The development of student feedback literacy: enabling uptake of feedback. Assessment & Evaluation in HigherEducation, 43(8), 1315-1325.
Clark, I. (2012). Formative assessment: Assessment is for self-regulated learning. Educational Psychology Review, 24(2), 205-249.
Cumming, A. (2013). Assessing integrated writing tasks: Promises and Perils. Language Assessment Quarterly, 10(1), 1-8.
Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347 https://doi.org/10.1177/ 0265532208090156.
DeLuca, C., & Klinger, D. A. (2010). Assessment literacy development: Identifying gaps in teacher candidates' learning. Assessment in Education: Principles, Policy & Practice, 17(4), 419–438.
DeLuca, C., & Klinger, D. A. (2010). Assessment literacy development: Identifying gaps in teacher candidates' learning. Assessment in Education: Principles, Policy & Practice, 17(4), 419–438.
Deluca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Teacher assessment literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28(3), 251-272.
Deygers, B., & Malone, M. E. (2019). Language assessment literacy in university admission policies, or the dialogue that isn't. Language Testing, 36(3), 347–368. https://doi. org/10.1177/0265532219826390
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language: A unit for all reasons. Applied linguistics, 21(3), 354-375.
Fulcher, G. (2012). Assessment literacy for language classroom, LanguageAssessment Quarterly, 9(2), 113-132.
Gardner, J. (2012). Assessment for Learning: A Compelling Conceptualization. In Gardner, J. (Ed.). Assessment and Learning. SAGE Publications.
Gu, P. Y. (2014). The unbearable lightness of the curriculum: What drives the assessment practices of a teacher of English as a foreign language in a Chinese secondary school? Assessment in Education: Principles, Policy & Practice, 21(3), 286-305.
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112.
Jeong, H. (2013). Defining assessment literacy: is it different for language testers and non-language testers? Language Testing, 30(3), 345–362. https://doi.org/10.1177/0265532213480334.
Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100–120. https://doi.org/10.1080/15434303.2019.1674855
Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy for in-service EFL teachers: The gaps. Studies in Educational Evaluation, 61, 112-122.
Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169–197. https://doi.org/10.1177/0265532214554321
Lee, J., & Butler, Y. G. (2020). Reconceptualizing language assessment literacy: Where are language learners? TESOL Quarterly, 54(4), 1098–1111. https://doi.org/10.1002/tesq.576
Malone, M. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329-344.
Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational researcher, 23(2), 13-23.
Pedder, D. & James, M. (2012). Professional Learning as a Condition for Assessment for Learning. In J. Gardner, (Ed.). Assessment and Learningc (pp.34-48). London: SAGE Publications.
Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128-138.
Popham, W. J. (2004). Why Assessment Illiteracy Is Professional Suicide. Educational Leadership, 62(1), 82.
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(1), 4-11.
Sato, T., & Ikeda, N. (2015). Test-taker perception of what test items measure: A potential impact of face validity on student learning. Language Testing in Asia, 5(1), 1–15. https://doi.org/10.1186/s40468-015-0019-z
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing,30(3), 309-327.
Shepard, L. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14.
Stiggins, R. J. (1999). Evaluating classroom assessment training in teacher education programs. Educational Measurement: Issues and practice, 18(1), 23-27.
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing 30(3), 403-412.
Vlanti, S. (2012). Assessment practices in the English language classroom of Greek junior high school. Research Papers in Language Teaching and Learning, 3(1), 92-122. https://rpltl.eap. gr/images/2012/RPLTL-03-01-fulltext.pdf
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374-402.
Volante, L., & Fazio, X. (2007). Exploring Teacher Candidates' Assessment Literacy: Implications for Teacher Education Reform and Professional Development. Canadian Journal of Education, 30(3), 749-770.
Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162.
Yim, O., & Ramdeen, K. T. (2015). Hierarchical cluster analysis: comparison of three linkage measures and application to psychological data. The quantitativemethods for psychology,11(1), 8-21.
Yorke, M. (2003) Formative assessment in higher education: Moves towards theory and enhancement of pedagogic practice, Higher Education, 45, 477–501.
', './data/jtls/coversheet/cover_en.jpg'))