Document Type : Research Paper
Authors
1 Associate Professor, TEFL Ferdowsi University of Mashhad
2 Ph.D., TEFL
Abstract
The aim of this study was to investigate the role of linguistic and intelligence factors in the Iranian IELTS candidates’ speaking performance. Linguistic factors include depth and breadth of vocabulary knowledge as well as grammar knowledge. Narrative and verbal intelligences represent the non-linguistic factors. The participants included 329 learners who took 5 validated tests and also participated in a simulated IELTS interview session. Model 1 (excluding the intelligence factors) represents the conventional view, whereas Model 2 (including all factors) is proposed for the first time in this study. The Structure Equation Modeling (SEM) was used to analyze the data. Using the SEM, both proposed models were examined to see which one fits the data more. The results of the comparisons made between the parameter estimates and fit indices of the two models demonstrate that Model 2 outfits Model 1, implying that in contrast to the conventional view, intelligence factors do play a significant and undeniable role in developing the speaking construct. Finally, the applications of the findings to promote the construct validity of IELTS are discussed.
Keywords
Arbuckle, J. A. (2007). Amos 16.0 user’s guide. Chicago: AMOS Development Corporation.
Ball, F., & Wilson, J. (2002). Research projects related to YLE speaking tests. Research Notes, 7, 8-10.
Bandura, A. (1982). Self efficacy mechanism in human agency. American Psychologist, 37, 122-147.
Brown, A., & Taylor, L. (2006). A worldwide survey of examiners’ views and experience of the revised IELTS speaking test. Research Notes, 26, 14-18.
Chen, M., & Zechner, K. (2011). Computing and evaluating syntactic complexity features for automated scoring of spontaneous nonnative speech. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, 722-731.
Cutrone, P. (2009). Overcoming Japanese EFL learners’ fear of speaking. University of Reading Language Studies Working Papers, 1, 55-63.
Develle, S. (2008). The revised IELTS pronunciation scale. Research Notes, 34, 36-39.
Dobson, S. (2005). Narrative competence and the enhancement of literacy: Some theoretical reflections. International Journal of Media, Technology, and Lifelong Learning, 1(2), 1-14.
Educational Testing Service (2005a). IELTS specimen material. Cambridge: Cambridge University Press.
Educational Testing Service. (2005b). TOEFL actual tests: 7 full-length paper-based exams administered in the past by ETS. Cambridge: Cambridge University Press.
Esquinca, A., Yaden, D., & Rueda, R. (2005). Current language proficiency tests and their implications for preschool English language learners. In J. Cohen, K. T. McAlister, K. Rolstad, & J. MacSwan (Eds.). Proceedings of the 4th international symposium on bilingualism (pp. 674-680). Somerville, MA: Cascadilla Press.
Fahim, M., & Pishghadam, R. (2007). On the role of emotional, psychometric, and verbal intelligences in the academic achievement of university students majoring in English language. Asian EFL Journal, 9, 240-253.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 48, 39-50.
Fulcher, G. (2003). Testing second language speaking. London: Longman.
Galaczi, E. (2005). Upper main suit speaking assessment: Toward an understanding of assessment criteria and oral examiner behavior. Research Notes, 20, 16-19.
Galaczi, E. D. (2010). Peer-peer interaction in a paired speaking test: The case of FCE. Research Notes, 42, 22.
Gardner, H. (1983). Frames of mind. New York: Basic books.
Horwitz, E. K., Horwitz, M. B., & Cope, J. A. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125-132.
Hubbard, C., Gilbert, S., & Pidcock, J. (2006). Assessment processes in speaking tests: A pilot verbal protocol study. Research Notes, 24, 14-19.
Huong, T. T. T. (2001). The predictive validity of the International English Language Testing System (IELTS) test. Post-Script, 2(1), 66-96.
Hussein, J. W. (2008). An existential approach to engaging adult learners in the process of legitimizing and constructing meanings from their narrative knowledge. Action Research, 6, 391-420.
Hymes, D. (1967). Models of interaction of language and social setting. Journal of Social Issues, 33(2), 8-28.
Kaplan, D. (2009). Structural equation modeling. London: Sage Publication.
Katayama, A. (2007). Japanese ESL students’ preferences toward correction of classroom oral errors. The Asian EFL Journal Quarterly, 9, 289-305.
Kim, H. J. (2010). Investigating the construct validity of a speaking performance test. Span Fellow Working Papers in Second or Foreign Language Assessment, 8, 1-30.
Kim, M. (2001). Detecting DIF across the different language groups in a speaking test. Language Testing, 18, 89-114.
Kim, Y. (2009). An investigation into native and nonnative teachers’ judgments of oral English performance: A mixed methods approach. Language Testing, 26, 187-217.
Lockley, T., & Farrell, S. (2011). Is grammar anxiety hindering English speaking in Japanese students? JALT Journal, 33(2), 175-190.
Luoma, S. (2004). Assessing speaking. Cambridge: Cambridge University Press.
Neville, H., Mills, D., & Lawson, D. (1992). Fractioning language: Different neural subsystems with different sensitive periods. Cerebral Cortex, 2, 244-258.
Nishino, T. (2008). Japanese secondary school teachers’ beliefs and practices regarding communicative language teaching: An exploratory survey. JALT Journal, 30, 27-50.
O’Sullivan, B., Weir, C. J., & Saville, N. (2002). Using observation checklists to validate speaking-test tasks. Language Testing, 19(1), 33-56.
Ohata, K. (2005). Language anxiety from the teacher’s perspective: Interviews with seven experienced ESL/EFL teachers. Journal of Language and Learning, 3, 133-155.
Pan, Y., & Pan, Y. (2011). Conducting speaking tests for learners of English as a foreign language. The International Journal of Educational and Psychological Assessment, 6(2), 83-100.
Pishghadam, R. (2009). Emotional and verbal intelligences in language learning. Iranian Journal of Language Studies, 3(1), 43-64.
Pishghadam, R., Baghaei, P., Shams, M., & Shamsaee, S. (2011). Construction and validation of a narrative intelligence scale with the Rasch rating scale model. International Journal of Educational and Psychological Assessment, 8(1), 75-90.
Pishghadam, R., & Shams, M. (in press). Pinpointing the classifiers of English language writing ability: A discriminant function analysis approach. Journal of Applied Research in English.
Qian, D. D. (1999). Assessing the roles of depth and breadth of vocabulary knowledge in reading comprehension. Canadian Modern Language Review, 56, 282-308.
Randall, W. L. (1999). Narrative intelligence and the novelty of our lives. Journal of Aging Studies, 13(1), 11-28.
Read, J. (2005). Applying lexical statistics to the IELTS speaking test. Research Notes, 20, 12-16.
Saito, H., & Ebsworth, M. (2004). Seeing English language teaching and learning through the eyes of Japanese EFL and ESL students. Foreign Language Annals, 37, 111-124.
Saville, N., & O’Sullivan, B. (2000). Developing observation checklists for speaking-tests. Research Notes, 3, 6-9.
Schmitt, N., Schmitt, D., & Calpham, C. (2001). Developing and exploring the behavior of two new versions of the Vocabulary Levels Test. Language Testing, 18, 55-88.
Schumacker, R. E., & Lomax, R. G. (2004). A beginner’s guide to structural equation modeling. London: Lawrence Erlbaum Association.
Segalowitz, N. (2010). Cognitive bases of second language fluency. New York: Routledge.
Shaw, S. D. (2003). CELS speaking assessment: Toward an understanding of oral examiner and test-taker behavior. Research Notes, 13, 16-19.
Silva, M. A. (2008). Development of the WAIS-III: A brief overview, history, and Description. Graduate Journal of Counseling Psychology, 1, 117-135.
Taylor, L. (2001a). The paired speaking test format: Recent studies. Research Notes, 6, 15-16.
Taylor, L. (2001b). Revising the IELTS speaking test: Developments in test format and task design. Research Notes, 5, 2-4.
Taylor, L. (2001c). Revising the IELTS Speaking Test: Retraining IELTS examiners worldwide. Research Notes, 6, 9-11.
Taylor, L. (2003). The Cambridge approach to speaking assessment. Research Notes, 13, 2-4.
Taylor, L., & Jones, N. (2001). Revising the IELTS speaking test. Research Notes, 4, 9-11.
Vidakovich, I., & Galaczi, E. (2009). ILEC speaking: Revising assessment criteria and scales. Research Notes, 35, 29-34.
Wechsler, D. (1981). Wechsler adult intelligence scale revised. San Antonio, TX: Psychological Corporation.
Wechsler, D. (1997). WAIS–III administration and scoring manual. San Antonio, TX: Psychological Corporation.
Young, D. J. (1992). Language anxiety from the foreign language specialists’ perspective: Interview with Krashen, Omaggio Hadley, Terrell, and Rardin. Foreign Language Annals, 25, 157-172.
', './data/jtls/coversheet/cover_en.jpg'))