A Multimodal Analysis of the Interplay between Visual and Verbal Semiotics in Creating Messages in Chinese Picture Books

Qing QIU


Children’s picture books play a fundamental part in the lives, entertainment, as well as education of children in some distinctive ways. Informed by Halliday’s (e.g. Halliday 1978/2001; Halliday 1994/2000) Systemic Functional Linguistics and Painter et al.’s visual narrative framework (Painter et al. 2013), this research is devoted to the analysis of textual choices available to the writer/illustrator to create coherent and meaningful messages in Chinese children’s picture books from a multimodal analysis perspective. The textual features of visual components are identified throughout the database, and the analysis of compositional interplay between verbal and visual semiotic systems is also conducted. It aims to elucidate how visual and verbal semiotic resources are co-deployed to create coherent and meaningful stories in Chinese children’s picture books.


Systemic Functional Linguistics; Textual Meanings; Multimodal Discourse Analysis; Chinese Picture Books

Full Text:



Halliday, M. A. K., & Matthiessen, C. M. I. M. (2009). Systemic functional grammar: A first step into the theory (Bilingual ed.; G. W. Huang and H. Y. Wang, Trans.). Beijing: Higher Education Press.

Halliday, M.A.K. (1978/2001). Language as social semiotic: The social interpretation of language and meaning. London: Arnold/Beijing: Foreign Language Teaching and Research Press.

Halliday, M.A.K. (1994/2000). An introduction to functional grammar (2nd ed.). London: Arnold/Beijing: Foreign Language Teaching and Research Press.

Halliday, M.A.K. (2007). Computing meanings: Some reflections on past experience and present prospects. In J. Webster, (Ed.), Collected Works of M. A. K. Halliday (Vol. 3): Computational and Quantitative Studies. London: Continuum.

Hood, S. (2008). Summary writing in academic contexts: Implicating meaning in processes of change. Linguistics and Education, (19), 351-365.

Hunt, P. (1994). An introduc0tion to children’s literature. Oxford University Press.

Kress, G. & van Leeuwen, T. (2006). Reading images: The grammar of visual design (2nd edn.). London: Routledge.

Martin, J. R. (1992). English text: System and structure. Amsterdam: Benjamins.

Martin, J. R., & Rose, D. (2003). Working with discourse: Meaning beyond the clause. London; New York: Continuum.

Martin, J. R., & Rose, D. (2008). Genre relations: Mapping culture. London: Equinox.

Martin, J. R., & White, P. (2005). The language of evaluation: Appraisal in English. New York: Palgrave Macmillan.

Matthiessen, C. M. I. M. (2009). Multisemiosis and context-based register typology: Registerial variation in the complementarity of semiotic systems. In E. Ventola & A. J. M. Guijarro (Eds.), The world told and the world shown (pp.11-38). Basingstoke, Hampshire: Palgrave Macmillan.

Nichols, S. (2002). Parents’ construction of their children as gendered, literate subjects: A critical discourse analysis. Journal of Early Childhood Literacy, 2 (2), 123-144.

Nikolajeva, M. & Scott, C. (2001). How picture books work. New York: Garland Publishing.

Nodelman, P. (1988). Words about pictures: The narrative art of children’s picture books. Athens and London: The University of Georgia Press.

O’Halloran, K. L. (2005). Mathematical discourse: Language, symbolism and visual image. London: Continuum.

Painter, C., & Martin, J. R. (2011). Intermodal complementarity: modelling affordances across image and verbiage in children’s picture books. In G. W. Huang (Ed.), Research in functional linguistics and discourse analysis (Vol 3). Beijing: Higher Education Press.

Painter, C., Martin, J. R., & Unsworth, L. (2013). Reading visual narratives: Image analysis of children’s picture books. London: Equinox.

Qiu, Q., & Hu, Y. (2016). The instantiation analysis of meaning construction
from the perspective of the social semiotics. Journal of Jiangxi Normal University (Social Sciences), (5), 84-89.

Rothery, J. & Stenglin, M. (2000). Interpreting literature: The role of Appraisal. In Unsworth, L. (ed.) Researching language in schools and communities: Functional linguistic perspectives (pp.222-244). London: Cassell.

Schwarcz, J. H. (1982). Ways of the illustrator: Visual communication in children’s literature. Chicago: American Library Association.

DOI: http://dx.doi.org/10.3968/11444


  • There are currently no refbacks.

Copyright (c) 2019 Qing QIU

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Share us to:   


Online Submissionhttp://cscanada.org/index.php/sll/submission/wizard


How to do online submission to another Journal?

If you have already registered in Journal A, then how can you submit another article to Journal B? It takes two steps to make it happen:

1. Register yourself in Journal B as an Author

Find the journal you want to submit to in CATEGORIES, click on “VIEW JOURNAL”, “Online Submissions”, “GO TO LOGIN” and “Edit My Profile”. Check “Author” on the “Edit Profile” page, then “Save”.

2. Submission

Go to “User Home”, and click on “Author” under the name of Journal B. You may start a New Submission by clicking on “CLICK HERE”.

We only use three mailboxes as follows to deal with issues about paper acceptance, payment and submission of electronic versions of our journals to databases: caooc@hotmail.com; sll@cscanada.net; sll@cscanada.org

 Articles published in Studies in Literature and Language are licensed under Creative Commons Attribution 4.0 (CC-BY).


Address: 1055 Rue Lucien-L'Allier, Unit #772, Montreal, QC H3G 3C4, Canada.
Telephone: 1-514-558 6138 
Website: Http://www.cscanada.net; Http://www.cscanada.org 
E-mailoffice@cscanada.net; office@cscanada.org; caooc@hotmail.com

Copyright © 2010 Canadian Academy of Oriental and Occidental Culture