Document Type : Research Paper
Authors
English Department, Humanities Faculty, Bu-Ali Sina University
Abstract
The significance of fairness in assessment is not a subject of doubt for educationalists even with fundamentally contrastive perspectives, but the study of methodological means for safeguarding this concept in educational classroom contexts has only received the scant attention of the researchers and educationalists. On this basis, this study intended to conceptualize foreign language (FL) classroom assessment fairness from EFL teachers' perspective. For this purpose and as a part of a larger enterprise, the researchers first strived for the creation and validation of a Classroom Assessment Fairness Scale (CAFS). This process was informed by the related literature and applied a critical incident technique. To verify the scale's validity and reliability, it was first expert viewed and modified accordingly; next pilot-tested on a group of 250 teachers, and finally, the amassed data were subjected to exploratory and confirmatory factorial analyses and internal consistency measures. The validated scale was taken by 120 Iranian EFL teachers. Descriptive analyses indicated that the EFL teachers were familiar with fairness principles in classroom assessment practices. They were aware of the significance of the opportunity to learn, the opportunity to demonstrate learning, the no-harm principle, the constructive classroom environment, and transparency as the constructive elements of classroom assessment practices' fairness. However, the same familiarity and awareness were not guaranteed for the score pollution component. The results further demonstrated that the teachers' gender, educational degree, teaching experience, and teaching context led to statistically significant differences among EFL teachers' attitudes to classroom assessment fairness.
Keywords
Main Subjects
Aitken, N. (2012). Student voice in fair assessment practice. In C. F. Webber & J. Lupart (Eds.), Leading student assessment, (pp. 175-200). Springer.
Alm, F. & Colnerud, G. (2015). Teachers' experiences of unfair grading. Educational Assessment, 20(2), 132–150. http://dx.doi.org/10.1080/10627197.2015.1028620.
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association, American Psychological Association, & National Council on Measurement in Education.
Azizi, Z. (2022). Fairness in assessment practices in online education: Iranian University English teachers’ perceptions. Language Testing in Asia, 12(14), 1-17. https://doi.org/10.1186/s40468-022-00164-7
Baniasadi, A., Salehi, K., Khodaie, E., Bagheri Noaparast, Kh. & Balal Izanloo, B. (2023). Fairness in classroom assessment: A systematic review. Asia-Pacific Edu Res, 32(1), 91–109. https://doi.org/10.1007/s40299-021-00636-z
Berg, B. L. (2001). Qualitative research methods for the social sciences. Allyn and Bacon.
Berti, C., Molinari, L., & Speltini, G. (2010). Classroom justice and psychological engagement: Students' and teachers' representations. Social Psychology of Education, 13(4), 541–556. http://dx.doi.org/10.1007/s11218-010-9128-9
Brookhart, S. (2004). Grading. Pearson.
Brown, G. T. L., Hui, S. K., Flora, W. M., & Kennedy, K. J. (2011). Teachers' conceptions of assessment in Chinese contexts: A tripartite model of accountability, improvement, and irrelevance. International Journal of Educational Research, 50(5), 307–320. http://dx.doi.org/10.1016/j.ijer.2011.10.003
Buzzelli, C. A. & Johnston, B. (2002). The moral dimensions of teaching: Language, power, and culture in classroom interaction. Routledge Falmer.
Camilli, G. (2006). Test fairness. In R. Brennan (Ed.). Educational measurement (pp. 221-256) (4th Ed.). American Council on Education and Praeger.
Catell, R. B. (1966). The scree test for number of factors. Multivariate Behavioral Research, 1(2), 245-276. http://dx.doi.org/10.1207/s15327906mbr0102_10
Colnerud, G. (1997). Ethical conflicts in teaching. Teaching and Teacher Education, 13(6), 627–635. https://doi.org/10.1016/S0742-051X(97)80005-4
Colnerud, G. (2015). Moral stress in teaching practice. Teachers and Teaching: Theory and Practice, 21(3), 346–360. https://doi.org/10.1080/13540602.2014.953820
Cowie, B. (2005). Student commentary on classroom assessment in science: A sociocultural interpretation. International Journal of Science Education, 27(2), 199-214. https://doi.org/10.1080/0950069042000276721
Cowie, B. (2015). Equity, ethics and engagement: Principles for quality formative assessment in primary science classrooms. In C. Milne, K. Tobin, & D. DeGennaro (Eds.). Sociocultural studies and implications for science education (pp. 117–133). Springer.
Chory-Assad, R. (2002). Classroom justice: Perceptions of fairness as a predictor of student motivation, learning, and aggression. Communication Quarterly, 50(1), 58-77. http://dx.doi.org/10.1080/01463370209385646
Chory, R. M. (2007). Enhancing student perceptions of fairness: The relationship between instructor credibility and classroom justice. Communication Education, 56(1), 89-105. http://dx.doi.org/10.1080/03634520600994300
Chory-Assad, R., & Paulsel, M. (2004). Antisocial classroom communication: Instructor influence and interactional justice as predictors of student aggression. Communication Quarterly, 52, 98–114. https://doi.org/10.1080/01463 37040 9370184
Darabi Bazvand, A. & Rasooli, A. (2022). Students’ experiences of fairness in summative assessment: A study in a higher education context. Studies in Educational Evaluation, 72, 101118. https://doi.org/10.1016/j.stueduc.2021.101118
DeLuca, C. (2012). Preparing teachers for the age of accountability: Toward a framework for assessment education. Teacher Education Yearbook XXI: A Special Issue of Action in Teacher Education, 34(5-6), 576–591. https://doi.org/10.1080/01626620.2012.730347
DeLuca, C., Chavez, T., Bellara, A., & Cao, C. (2013). Pedagogies for pre-service assessment Education: Supporting teacher candidates' assessment literacy development. The Teacher Educator, 48(2), 128-142. https://doi.org/10.1080/08878730.2012.760024
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016a). Approaches to classroom assessment inventory: A new instrument to support teacher assessment literacy, Educational Assessment, 21(4), 248-266, http://dx.doi.org/10.1080/10627197.2016.1236677
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016b). Teacher assessment literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28(3), 251–272. https://link.springer.com/article/10.1007/s11092-015-9233-6
DeLuca, C., Valiquette, A., Coombs, A., LaPointe-McEwan, D. & Luhanga, U. (2016). Teachers' approaches to classroom assessment: a large-scale survey. Assessment in Education: Principles, Policy & Practice, 25(4), 355-375. https://doi.org/10.1080/0969594X.2016.1244514
Dorans, N. J., & Cook, L. L. (2016). Fairness in educational assessment and measurement. Routledge.
Dornyei, Z. (2003). Questionnaires in second language research: Construction, administration and processing. Lawrence Erlbaum Associates.
Downing, S. M. & Haladyna, T. M. (2004). Validity threats: Overcoming interference with proposed interpretations of assessment data. Medical Education, 38(3), 327-333. DOI: 10.1046/j.1365-2923.2004.01777.x
Duncan, C. R., & Noonan. B. (2007). Factors affecting teachers' grading and assessment practices. Alberta Journal of Educational Research, 53(1), 1–21. https://doi.org/10.11575/ajer.v53i1.55195
Fan, X., Johnson, R. & Liu, X. (2017). Chinese university professors' perceptions about ethical issues in classroom assessment practices. New Waves Educational Research & Development, 20(2), 1–19. https://files.eric.ed.gov/fulltext/EJ1211389.pdf
Fan, X., Johnson, R., Liu, X., Zhang, X., Liu, X., & Zhang, T. (2019). A comparative study of pre-service teachers' views on ethical issues in classroom assessment in China and the United States. Frontiers of Education in China, 14(2), 309–32. https://link.springer.com/article/10.1007/s11516-019-0015-7
Fan, X., Liu, X., & Johnson, R. (2020). A mixed method study of ethical issues in classroom assessment in Chinese higher education. Asia Pacific Education Review, 21, 183-195. https://doi.org/10.1007/s12564-019-09623-y
Fan, X., Johnson, R., Liu, X., & Gao, R. (2020). College students' views of ethical issues
in classroom assessment in Chinese higher education. Studies in Higher
Education, 47(1), 131-145. https://doi.org/10.1080/03075079.2020.1732908
in classroom assessment in Chinese higher education. Studies in Higher
Education, 47(1), 131-145. https://doi.org/10.1080/03075079.2020.1732908
Flores, M. A., Veiga Simão, A. M., Barros, A., & Pereira, D. (2015). Perceptions of effectiveness, fairness and feedback of assessment methods: A study in higher education. Studies in Higher Education, 40(9), 1523–1534. http://dx.doi.org/10.1080/03075079.2014.881348
Fornell, C. & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.2307/3151312
Gordon, M. E., & Fay, C. H. (2010). The effects of grading and teaching practices on students' perceptions of grading fairness. College Teaching, 58(3), 93–98. https://www.jstor.org/stable/41305091
Green, S. K. & Johnson, R. L. (2010). Assessment is essential. McGraw-Hill Higher Education.
Green, S., Johnson, R., Kim, D., & Pope, N. (2007). Ethics in classroom assessment practices: issues and attitudes. Teaching and Teacher Education, 23(7), 999-1011. https://doi.org/10.1016/j.tate.2006.04.042
Hair, J. F. J., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. Prentice hall.
Hair, J. F. J., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2014). A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publication.
Hamzelou, Z., Alavi, S. M., & Nemati, M. (2022). Integration of learning-oriented assessment into writing instruction: A case of IELTS writing preparation class. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 41(3), 57-87. doi: 10.22099/tesl.2022.35693.2761
Herman, J., & Cook, L. (2019). Fairness in classroom assessment. In S. M. Brookhart & J. H. McMillan (Eds.), Classroom assessment and educational measurement (pp. 243-264). Routledge.
Hidri, S. (2016). Conceptions of assessment: Investigating what assessment means to
secondary and university teachers. Arab Journal of Applied Linguistics, 1(1), 19–43.
secondary and university teachers. Arab Journal of Applied Linguistics, 1(1), 19–43.
Hu, L. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. SEM, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Homayounzadeh, Z., & Razmjoo, S. A. (2021). Examining 'assessment literacy in practice' in an Iranian context: Does it differ for instructors and learners? Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 40(2), 1-45. doi: 10.22099/jtls.2021.40269.2978
Ishak, Z., & Fin, L. (2013). Truants’ and teachers’ behaviors in the classroom. Procedia-Social and Behavioral Sciences, 103, 1228–1237. https://doi.org/10.1016/j.sbspro.2013.10.451
James, M. & Pedder, D. (2006). Beyond method: Assessment and learning practices and values. The Curriculum Journal, 17(2), 109–138. https://doi.org/10.1080/09585170600792712
Kaufman, E., & Killen, M. (2022). Children’s perspectives on fairness and inclusivity in the classroom. The Spanish Journal of Psychology, 25, 28. 1-11. DOI:10.1017/SJP.2022.24
Kippers, W. B., Wolterinck, Ch. H. D., Schildkamp, K., Poortman, C. L., & Visscher, A. J. (2018). Teachers' views on the use of assessment for learning and data-based decision making in classroom practice. Teaching and Teacher Education, 75, 199-213. https://doi.org/10.1016/j.tate.2018.06.015
Kunnan, A. J. (2018). Evaluating language assessments. Routledge.
Lantolf, J., & Poehner, M. (2013). The unfairness of equal treatment: Objectivity in L2
testing and dynamic assessment. Educational Research and Evaluation, 19, 141–157.
http://dx.doi.org/10.1080/13803611.2013.76761
testing and dynamic assessment. Educational Research and Evaluation, 19, 141–157.
http://dx.doi.org/10.1080/13803611.2013.76761
Liu, J., Johnson, R., & Fan, X. (2016). A comparative study of Chinese and United States pre-service teachers' perceptions about ethical issues in classroom assessment. Studies in Educational Evaluation, 48, 57–66. http://dx.doi.org/10.1016/j.stueduc.2016.01.002
Lupart, J., & Webber, C. F. (1996). Schools in transition: Issues and prospects. In J. Lupart, A. Mckeough, & C. Yewchuk (Eds.), Schools in transition (pp. 3–39). Nelson Canada.
Maclellan, E. (2004). Initial knowledge states about assessment: Novice teachers' conceptualizations. Teaching and Teacher Education, 20(5), 523-535. https://doi.org/10.1016/j.tate.2004.04.008
Mauldin, R. K. (2009). Gendered perceptions of learning and fairness when choice between exam types is offered. Active Learning in Higher Education, 10(3), 253-264. http://dx.doi.org/10.1177/1469787409343191
McGee, J. & Colby, S. (2014). Impact of an assessment course on teacher candidates' assessment literacy. Action in Teacher Education, 36(5-6), 522-532. https://doi.org/10.1080/01626620.2014.977753
McMillan, J. H. (2011). Classroom assessment: Principles and practice for effective standards-based instruction (5th ed.). Pearson Education Inc.
Mislevy, R. J. (2018). Sociocognitive foundations of educational measurement. Routledge.
Molinari, L., Speltini, G., & Passini, S. (2013). Do perceptions of being treated fairly increase students' outcomes? Teacher–student interactions and classroom justice in Italian adolescents. Educational Research and Evaluation, 19(1), 58–76. http://dx.doi.org/10.1080/13803611.2012.748254
Murdock, T., Miller, A., & Goetzinger, A. (2007). Effects of classroom context on university students’ judgments about cheating: Mediating and moderating processes. Social Psychology of Education, 10, 141–169. https://doi.org/10.1007/s11218-007-9015-1
Murillo, F. J., & Hidalgo, N. (2017). Students' conceptions about a fair assessment of their learning. Studies in Educational Evaluation, 53, 10-16. http://dx.doi.org/101016/j.stueduc.2017.01.001
Murillo, F. J., & Hidalgo, N.(2020). Fair student assessment: A phenomenographic study on teachers’ conceptions. Studies in Educational Evaluation, 65, 1-10. https://doi.org/10.1016/j.stueduc.2020.100860
Nisbet, I. (2017). Fairness takes center stage. Assessment in Education: Principles, Policy & Practice, 26(1), 1–7. https://doi.org/10.1080/0969594X.2017.1358151
Nisbet, I. & Shaw, S. D. (2019). Fair assessment viewed through the lenses of measurement theory. Assessment in Education: Principles, Policy & Practice, 26(5), 612-629. https://doi.org/10.1080/0969594X.2019.1586643
Pallant, J. (2013). A step by step guide to data analysis using IBM SPSS. Mc Graw Hill.
Paulsel, M., Chory-Assad, R., & Dunleavy, K. N. (2005). The relationship between student perceptions of instructor power and classroom justice. Communication Research Reports, 22(3), 207–215. https://doi.org/10.1080/00036810500207030
Pepper, M. B., & Pathak, S. (2008). Classroom contribution: What do students perceive as fair assessment? Journal of Education for Business, 83(6), 360–368. http://dx.doi.org/10.3200/JOEB.83.6.360-368
Peters, R., Kruse, J., Buckmiller, T., & Townsley, M. (2017). It’s just not fair! making sense of secondary students’ resistance to a standards-based grading. American Secondary Education, 45(3), 9–27.
Pettifor, J. L. & Saklofske, D. H. (2012). Fair and ethical student assessment practices. In Webber, C. F., Lupart, J. (Eds.), Leading student assessment (pp. 87-106). Springer.
Pope, N., Green, S., Johnson, R., & Mitchell, M. (2009). Examining teacher ethical dilemmas in classroom assessment. Teaching and Teacher Education, 25(5), 778-782.
Rasooli, A., Zandi, H., & DeLuca, C. (2018). Re-conceptualizing classroom assessment fairness: A systematic meta-ethnography of assessment literature and beyond. Studies in Educational Evaluation, 56, 164-181. https://doi.org/10.1016/j.stueduc.2017.12.008
Rasooli, A., DeLuca, Ch., Resegh, A., & Fathi, S. (2019). Students' critical incidents of fairness in classroom assessment: an empirical study. Social Psychology of Education, 22, 701-722. https://doi.org/10.1007/s11218-019-09491-9
Rasooli, A., Rasegh, A., Zandi, H. & Firoozi, T. (2022). Teachers’ conceptions of fairness in classroom assessment: An empirical study. Journal of Teacher Education, 74(3), 260-273. https://doi.org/10.1177/00224871221130742
Resh, N. (2009). Justice in grades allocation: Teachers' perspective. Social Psychology of Education, 12(3), 315-25. https://link.springer.com/article/10.1007%2Fs11218-008-9073-z
Rezai, A., Alibakhshi, G., Farokhipour, S., & Miri, M. (2021). A phenomenographic study on language assessment literacy: Hearing from Iranian university teachers. Language Testing in Asia, 11, 1–18. 10.1186/s40468-021-00142-5
Rubie-Davies, C. M., Flint, A. Y., & McDonald, L. G. (2012). Teacher beliefs, teacher characteristics, and school contextual factors: What are the relationships? British Journal of Educational Psychology, 82(2), 270–288. https://doi.org/10.1111/j.2044-8279.2011.02025.x
Russell, M. K. & Airasian, P. W. (2012). CA: Concepts and applications (7th ed.). McGraw-Hill Higher Education.
Scott, S., Webber, C. F., Lupart, J. L., Aitken, N., & Scott, D. E. (2014). Fair and equitable assessment practices for all students. Assessment in Education: Principles, Policy & Practice, 21(1), 52-70. https://doi.org/10.1080/0969594X.2013.776943
Shah Ahmadi, M., & Ketabi, S. (2019). Features of language assessment literacy in Iranian English language teachers' perceptions and practices. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 38(1), 191-223. doi: 10.22099/jtls.2020.34843.2739
Shepard, L. (2006). Classroom assessment. In R. L. Brennan (Ed.), Educational measurement (pp. 623–646). National Council on Measurement in Education, American Council on Education/Praeger Publishers.
Smith, J. K., Smith, L. F., & DeLisi, R. (2001). Natural classroom assessment: Designing seamless instruction and assessment. Corwin Press.
Soodmand Afshar, H. & Ranjbar, N. (2021). EAP teachers' assessment literacy: From theory to practice. Studies in Educational Evaluation, 70(4), 1-14 https://doi.org/10.1016/j.stueduc.2021.101042
Soodmand Afshar, H., Tofighi, S., Assodeh, M. & Ranjbar, N. (2018). The impact of alternative assessment knowledge, teaching experience, gender, and academic degree on EAP teachers' assessment literacy. Iranian Journal of English for Academic Purposes, 7(2), 1-15. 20.1001.1.24763187.2018.7.2.1.6
Taylor, K. & Nolen, S. (2005). Classroom assessment: Supporting teaching and learning in real classrooms. Pearson Education.
Tierney, R. (2013). Fairness in classroom assessment. In J. H. McMillan (Ed.). Sage handbook of research on classroom assessment (pp. 125-144). Thousand Oaks, CA: SAGE Publications.
Tierney, R. (2014). Fairness as a multifaceted quality in classroom assessment. Studies in Educational Evaluation, 43, 55-69. https://doi.org/10.1016/j.stueduc.2013.12.003
Tierney, R. (2015). Altered grades: A grey zone in the ethics of classroom assessment. Assessment Matters, 8, 5–30. http://dx.doi.org/10.18296/am.0002
Tierney, R. (2016). Fairness in educational assessment. In M. A. Peters (Ed.). Encyclopedia of educational philosophy and theory (pp. 1-6). Springer Singapore.
Torkey, S. A. & Sayed Haider, N. A. (2017). Ethicality in EFL classroom assessment: Bridging the gap between theory and practice. In S. Hidri & C. Coombe (Eds.), Evaluation in foreign language education in the Middle East and North Africa (pp. 59-85). Springer.
Vandeyar, S. Y. & Killen, R. (2007). Educators' conceptions and practice of classroom assessment in post-apartheid South Africa. South African Journal of Education, 27(1), 101–115. https://www.ajol.info/index.php/saje/article/view/25101
Warnick, B. R. & Silverman, S. K. (2011). A framework for professional ethics courses in teacher education. Journal of Teacher Education, 62(3), 273-285. https://doi.org/10.1177/0022487110398002
Weber, R. P. (1990). Basic content analysis. Sage Publications.
Wendorf, C. A., & Alexander, S. (2005). The influence of individual- and class-level fairness-related perceptions on student satisfaction. Contemporary Educational Psychology, 30(2), 190–206. https://doi.org/10.1016/j.cedpsych.2004.07.003
Xu, Y., & Brown, G. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162. https://doi.org/10.1016/j.tate.2016.05.010
Zhang, Z., & Burry-Stock, J. (2003). Classroom assessment practices and teachers' self-perceived assessment skills. Applied Measurement in Education, 16(4), 323-342. https://doi.org/10.1207/S15324818AME1604_4
Zolfaghari, S., & Ashraf, H. (2015). The relationship between EFL teachers' assessment literacy, their teaching experience, and their age: A case of Iranian EFL teachers. Theory and Practice in Language Studies, 5(12), 2550-2556.
', './data/jtls/coversheet/cover_en.jpg'))