Document Type : Research Paper
Authors
Kharazmi University
Abstract
This study drew upon Kress and Van Leeuwen’s (2006, [1996]) visual grammar and Van Leeuwen’s (2008) social semiotic model to interrogate ways through which social actors of different races are visually and textually represented in four award-winning English-learning software packages. The analysis was based on narrative actional/reactional processes at the ideational level; mood, perspective, social distance, and modality at the interpersonal level; and salience, framing, and vector at the compositional level. The findings revealed that although contemporary multimodal texts have tried to be unbiased and neutral in the verbal mode, there are still traces of discrimination, bias, and stereotyping in the visual mode. The results of this research can be of potential help and use for researchers, pedagogues, material developers, software designers, teachers , and students to become visually literate and get aware of the hidden messages that can be communicated by images in textbooks and multimedia.
Keywords
Abbas-Nejad-Konjin, A. (2012). Gender analysis of Iranian middle school textbooks. (Unpublished MA thesis). UBC, Vancouver, Canada.
Adami, E. (2013). A social semiotic multimodal analysis framework for website interactivity. London: National Center for Research Methods.
Ansary, H., & Babaii, E. (2003). On the manifestation of subliminal sexism in current Iranian secondary school ELT textbooks. Iranian Journal of Applied Linguistics, 6, 57-69.
Babaii, E., & Ansary, H. (2001, March). The structure of and stricture on TV Commercials in Iran. Paper presented at the 5th Conference on Theoretical and Applied Linguistics. Tehran: Allameh Tabataba'i University.
Baldry, A. P. (2000). Multimodality and multimodality in the distance learning age. Campobasso, Italy: Palladino Editore.
Baldry, A. P. (2004). Phase and transition type and instance: patterns in media texts as seen through a multimodal concordancer. In K. L. O’Halloran (Ed.), Multimodal discourse analysis (pp. 83-108). London: Continuum.
Baldry, A. P., & Thibault, P. J. (2006). Multimodal transcription and text analysis. London: Equinox.
Barthes, R. (1977). Image, music, text. London: Fontana/Collins.
Belknap, P., & Leonard, W. M. (1991). A conceptual replication and extension of Erving Goffman’s study of gender advertisements. Sex Roles, 25(3/4)103-118.
Berger, J. (1972). Ways of seeing. London: BBC/Harmondsworth: Penguin.
Binns, J. C., & Branch, R. C. (1995). Gender stereotyped computer clip-art images as an implicit influence in instructional message design. ERIC: ED 3080089
Bishop, H., & Jaworski, A. (2003). We beat ‘em’: nationalism and the hegemony of homogeneity in the British press reportage of Germany versus England during Euro 2000. Discourse & Society, 14(3), 243–271.
Blommaert, J. (2005). Discourse: A critical introduction. Cambridge: Cambridge University Press.
Brand, J. E., Knight, S., & Majewski, J. (2003). The diverse worlds of computer games: A content analysis of spaces, populations, styles and narratives. Paper presented at Digital Games Research Conference, The Netherlands. ISBN / ISNN: ISSN 2342-9666.
Caldas-Coulthard, C. R. (2003). Cross-Cultural Representation of ‘Otherness’ in Media Discourse. In G. Weiss & R. Wodak, (Eds.), Critical discourse analysis:Theory and interdisciplinarity (pp. 272-296). New York: Palgrave McMillan.
Caldas-Coulthard, C. R., & Iedema, R. (2008). Identity trouble: Critical discourse and contested identities. New York: Palgrave Macmillan.
Camiciottoli, B. C. (2007). The language of business studies lectures. Amsterdam / Philadelphia: John Benjamins Publishing Company.
Canning-Wilson, C. (1999). Using pictures in EFL and ESL classrooms. ERIC No: ED 445526. Retrieved from the ERIC database
Chappell, K. K. (1996). Mathematics computer software characteristics with possible gender-specific impact: A content analysis. Journal of Educational Computing Research, 15, 25–35.
Chiew, A. (2004). Multisemiotic mediation in hypertext. In K. L. O’Halloran (Ed.), Multimodal discourse analysis: Systemic-functional perspectives (pp. 131-162). London: Continuum.
Coelho, Z. P. (2008). Front page layout and reading paths: The influence of age on newspaper reading. Estudos em Comunicação, 4, 1-14.
Drees, D. E., & Phye, G. D. (2001). Gender representation in children’s language arts computer software. Journal of Educational Research, 95, pp. 49–55.
Fairclough, N. (1989). Language and power. London: Longman.
Fairclough, N. (1995). Critical discourse analysis: The critical study of language. London and New York: Longman.
Gamson, W. A., Croteau, D., Hoynes, W., & Sasson, T. (1992). Media images and the social construction of reality. Annual Review of Sociology, 18,373-393.
Gharbavi, A. & Mousavi, S. A. (2012). The application of functional linguistics in exposing gender bias in Iranian high school English textbooks. English Language and Literature Studies, 2(1), 85-93.
Goffman, E. (1979). Gender advertisements. Cambridge, MA: Harvard University Press.
Graci, J. P. (1989). Are foreign language textbooks sexist? Exploration of models of evaluation. Foreign Language Annals, 22, 77-86. Retrieved from http://dx.doi.org/10.1111/j.1944-9720.1989.tb02771.x
Griffiths, Th. (2010). Media representation theory. Retrieved from http://www.slideshare.net/Tomaskas/media-representation-theory.
Guijarro, J. M., & Sanz, J. M. P. (2008). Compositional, interpersonal and representational meanings in a children’s narrative: A multimodal discourse analysis. Journal of Pragmatics, 40,1601–1619.
Halliday, M. A. K. (1978). Language as social semiotic: The social interpretation of language and meaning. London: Edward Arnold.
Halliday, M. A. K. (1985). Introduction to functional grammar. London: Arnold.
Hartman, P. L., & Judd, E. L. (1978). Sexism and TESOL materials. TESOL Quarterly, 12(4), 383-393.
Hellinger, M. (1980). For men must work, and women must weep: Sexism in English language textbooks used in German schools. In C. Kramerae (Ed.), The voices and words of women and men (pp. 267-274).New York: Pergamon Press.
Hietala, V. (1996). The reality of the images. Introduction to the understanding and interpretation of visual culture. Helsinki: Kirjastopalvelu.
Hjorth, J. (1997). Presentation of females and males in an English textbook series for Finnish upper-secondary schools (Unpublished Pro Gradu Thesis). University of Jyväskylä, Finland. Retrieved from https://jyx.jyu.fi/dspace/handle/123456789/7366
Horváth Futó, H. (2011). Textbooks and stereotypes. Philologica, 3(2), 265-278.
Iedema, R. (2001). Analyzing film and television: A social semiotic account of hospital: An unhealthy business. In T. Van Leeuwen, & C. Jewitt (Eds.), Handbook of visual analysis (pp. 183-204). London: Sage.
Iedema, R. (2003). Multimodality, resemioticization: extending the analysis of discourse as a multisemiotic practice. Visual Communication, 2(1), 29–57.
Jarić, I. (2002). Gender Stereotypes. Nova srpska politička misao, 2(Special issue), 5-19.
Jewitt, C. (2004). Multimodality and new Communication technologies. In P. LeVine & R. Scollon (Eds.) Discourse and Technology: Multimodal discourse analysis (pp. 184-195). Washington: Georgetown University Press.
Jewitt, C. (2005). Multimodality, ‘Reading’, and ‘Writing’ for the 21st Century. Discourse: Studies in the Cultural Politics of Education, 26(3), 315-331.
Jones, R. S. (2005). Sites of engagement as sites of attention: time, space and culture in electronic discourse. In S. Norris, & R. H. Jones (Eds.), Discourse in action. Introducing mediated discourse analysis (pp. 141-154). London: Routledge.
Kern, R. (2006). Perspectives on Technology in Learning and Teaching Languages. TESOL Quarterly, 40(1), 183-210.
Knox, J. S. (2009). Punctuating the home page: image as language in an online newspaper. Discourse & Communication, 3(2), 145–172.
Kordjazi, Z. (2012). Images matter: A semiological content analysis of gender positioning in contemporary English-learning software applications. Novitas-ROYAL 6(1), 59-80.
Kress, G., & Van Leeuwen, Th. (2006 [1996]). Reading images: The grammar of visual design (2nd Ed.). London: Routledge.
Lee, J. F. K., & Collins, P. (2006). Gender Representation in Hong Kong English Textbooks. Retrieved from http://www.eoc.org.hk/eoc/upload/2006711112336211184.pdf.
Lemke, J. (1998). Multiplying meaning: visual and verbal semiotics in scientific text. In R. Martin & R. Veel (Eds.), Reading science: critical and functional perspectives on discourse and science (pp. 87-113). London: Routledge.
Lemke, J. (2002). Travels in hypermodality. Visual Communication, 1(3), 299–325.
Lester, P. (2000). Visual communication: Images with messages. Belmont. CA: Wadsworth/Thomson.
Lim Fei, V. (2007). The visual semantics stratum: making meaning in sequential images. In T. D., Royce, & W. L., Bowcher (Eds.), New Directions in the analysis of multimodal discourse (pp. 195–213).Mahwah: Lawrence Erlbaum.
Lim Fei, V. & O‘Halloran, K. (2010, Accepted for Publication). The ideal teacher: An analysis of a teacher-recruitment advertisement. Semiotica.
Liu, Y., & O’Halloran, K. L. (2009; accepted for publication). Inter-semiotic Texture: Analyzing cohesive devices between language and images. Social Semiotics.
Machin, D., & Mayr, A. (2007). Antiracism in the British government's model regional newspaper: the ‘talking cure’. Discourse & Society, 18(4), 453–477.
Machin, D., & Van Leeuwen, T. (2009). Toys as discourse: Children’s toys and the war on terror. Critical Discourse Studies, 6(1), pp. 51-63.
Mazid, B. M. (2008). Cowboy and misanthrope: a critical (discourse) analysis of Bush and bin Laden cartoons. Discourse & Communication, 2(4), 433-457.
Milburn, S.S., Carney, D. R., & Ramirez, A. H. (2001). Even in modern media, the picture is still the same: A content analysis of clipart images. Sex Roles, 44, 277-294.
Moebius, W. (1986). Introduction to picturebooks codes. Word and Image, 2, 141–158.
Nodelman, P. (1988). Words about pictures: The narrative art of children’s picturebooks. athens: The University of Georgia Press.
Nodelman, P. (1999). Decoding the images. How picture books work. In P. Hunt (Ed.), Understanding children’s literature (pp. 129–139). London/New York: Routledge.
Norris, S. (2004). Multimodal discourse analysis: A conceptual framework. In P. LeVine, & R. Scollon (Eds.), Discourse and technology. Multimodal discourse analysis (pp. 101-115). Washington: Georgetown University Press.
O’Halloran, K. L. (2000). Classroom discourse in mathematics: a multi-semiotic analysis. Linguistics and Education, 10(3), 359–388.
O’Halloran, K. L. (2004). Multimodal discourse analysis: Systemic-functional perspectives. London: Continuum.
O'Halloran, K. L. (2005). Mathematical discourse: Language, symbolism and visual images. London and New York: Continuum.
O'Halloran, K. L. (2009). Multimodal analysis and digital technology, In A. Baldry & E. Montagna (Eds.), Interdisciplinary perspectives on multimodality: Theory and practice, proceedings of the third international conference on multimodality (pp. 1-26). Campobasso: Palladino.
O’Halloran, K. L. (in press 2011). Multimodal discourse analysis. In K. Hyland, & B. Paltridge (Eds.), Companion to discourse (pp. 1-33). London and New York: Continuum.
O’Halloran, K. L., Podlasov, A., Chua, A. & K. L. E., M. (2012). Interactive software for multimodal analysis. Visual Communication, 11(3), 363–381.
Ollivier, K. E. (1992). Gender stereotyping in elementary school textbooks (Unpublished Master’s thesis). University of British Colombia, Vancouver, Canada.
Otlowski, M. (2003). Ethnic diversity and gender bias in EFL textbooks. Asian EFL Journal 5(3), 1-15.
O'Toole, M. (2010 [1994]). The Language of displayed art (2nd Ed). London and New York: Routledge.
Pauwels, L. (2012). A multimodal framework for analyzing websites as cultural expressions. Journal of Computer-Mediated Communication, 17, 247–265.
Peterson, S., & Kroner, T. (1992). Gender biases in textbooks for introductory psychology and human development. Psychology of Women Quarterly, 16, 17-37.
Porreca, K. L. (1984). Sexism in current ESL textbooks. TESOL Quarterly, 18, 704-707.
Retrieved from http://dx.doi.org/10.2307/3586584.
Poulou, S. (1997). Sexism in the discourse roles of textbook dialogues. Language Learning, 15, 68-73.
Retrieved from http://dx.doi.org/10.1080/09571739785200141.
Prodromou, L. (1988). English as cultural action. ELT Journal, 42(2), 73-83.
Reese, L. (1994). Gender equality and texts. Social Studies Reviews, 33, 12-15.
Royce, T. D. (1998). Synergy on the page: Exploring intersemiotic complementarity in pagebased multimodal text. In JASFL Occasional Papers 1 (pp. 25–49). Tokyo, Japan: Association of Systemic Functional Linguistics ( JASFL).
Royce, T. D. (2002). Multimodality in the TESOL classroom: Exploring visual-verbal synergy. TESOL Quarterly, 36(2), 191-205.
Royce, T. D. (2007). Intersemiotic complementarity: A framework for multimodal discourse analysis. In T. D. Royce, & W. L. Bowcher (Eds.), New directions in the analysis of multimodal discourse (pp. 63–110). Mahwah: Lawrence Erlbaum.
Sheldon, J. P. (2004). Gender stereotypes in educational software for young children. Sex Roles, 51, 433-444.
Sunderland, J. (1992). Gender in the EFL classroom. ELT Journal, 46, 81-91.
Tahririan, M. H., & Sadri, E. (2013). Analysis of images in Iranian high school EFL course books. Iranian Journal of Applied Linguistics, 16(2), 137-160.
Thibault, P. J. (2000). The multimodal transcription of a television advertisement: Theory and practice. In A. Baldry (Ed.), Multimodality and multimediality in the distance learning age (pp. 31-84). Lampo: Campo Basso.
Thompson, K. (2002). A critical discourse analysis of world music as the 'other' in education. Research Studies in Music Education, 19(14), 14-21.
Unsworth, L. (2008). Multiliteracies and metalanguage: describing image/text relations as a resource for negotiating multimodal texts. In D. L. D. Corio, M. Knobel, & C. Lankshear (Eds.), Handbook of research on new literacies (pp. 377- 405). New Jersey: Erlbaum.
Unsworth, L., & Wheeler, J. (2002). Re-valuing the role of images in reviewing picture books. Reading: Language and Literacy, 36(2), 68–74.
Van Dijk, T. A. (2001). Critical discourse analysis. In D. Tannen, D. Schiffrin & H. Hamilton (Eds.), Handbook of discourse analysis (pp. 352-371). Oxford: Blackwell.
Van Dijk, T. A. (2006). Discourse and manipulation. Discourse & Society, 17(2), 359–383.
Van Leeuwen, T. (2003). A multimodal perspective on composition. In T. Ensink & C. Sauer (Eds.), Framing and perspectivising in discourse (pp. 23-62). Amsterdam/Philadelphia: John Benjamins Publishing Company.
Van Leeuwen, T. (2008). Discourse and practice: New tools for critical discourse analysis. New York: Oxford University Press.
Ventola, E., Charles, C, & Kaltenbacher, M. (Eds.) (2004). Perspectives on multimodality. Amsterdam: John Benjamins.
Young, K. (2009). Applying multimodal analysis to popular websites to develop students’ digital literacy. Proceedings of the 17th International Conference on Computers in Education. Hong Kong: Asia-Pacific Society for Computers in Education.
', './data/jtls/coversheet/cover_en.jpg'))