Multimodality, AI and pedagogy: A framework for empirical precision

Conference keynote

Castaldi, J. 2025. Multimodality, AI and pedagogy: A framework for empirical precision.
AuthorsCastaldi, J.
TypeConference keynote
Description

Multimodality stands in a privileged position when undertaking research efforts in the field of pedagogy thanks to its capacity to dissect educational environments, both physical and digital, and explore how teaching and learning occur.

At the same time, however, calls have been made from different corners of the multimodal research community to strive for more precise theories, methodologies and methods (Bateman, 2021; Castaldi 2024). This also applies to the area of pedagogy and AI-integrated teaching and learning.

This keynote will take stock on the current state of multimodal research in AI in education and outline a theoretical framework for empirical precision.

KeywordsMultimodal literacy; Multimodal pedagogy; Empirical research; AI-assisted education
Year2025
Conference6th International Technology-enhanced Language Learning Symposium
Related URLhttps://itells.wixsite.com/itell/itells2025
File
File Access Level
Controlled
Publication process dates
Deposited23 Jul 2025
Permalink -

https://repository.canterbury.ac.uk/item/9v7wz/multimodality-ai-and-pedagogy-a-framework-for-empirical-precision

  • 324
    total views
  • 1
    total downloads
  • 3
    views this month
  • 0
    downloads this month

Export as

Related outputs

The multimodal construction of empathy in the representation of Ukrainian displaced people: The case of British television
Castaldi, J. 2025. The multimodal construction of empathy in the representation of Ukrainian displaced people: The case of British television.
Multimodal discourse reception: ​Approaches and methods
Castaldi, J. and Bucher, H.-J. 2025. Multimodal discourse reception: ​Approaches and methods.
Linguistics, media discourse and multimodality
Castaldi, J. 2025. Linguistics, media discourse and multimodality.
Multisensory processing, affect and multimodal manipulation: Investigating travel documentaries
Castaldi, J. 2025. Multisensory processing, affect and multimodal manipulation: Investigating travel documentaries. in: Feeling, Skill and Knowledge: Semiotics of the Subject in Environment, Culture and World Cham Springer Nature. pp. 37-48
Integrating multimodality and reception studies for research in the humanities and social sciences
Castaldi, J. 2025. Integrating multimodality and reception studies for research in the humanities and social sciences.
Multimodality and reception studies
Castaldi, J. 2025. Multimodality and reception studies. Visual Communication. 24 (3). https://doi.org/10.1177/14703572251331136
Investigating ideology, manipulation, and text interpretation in documentary films
Castaldi, J. 2025. Investigating ideology, manipulation, and text interpretation in documentary films.
Investigating multimodality, reception and civic participation on YouTube. A case study of the documentary “Greece: The Hidden War”
Castaldi, J. and Foundouka, I. 2025. Investigating multimodality, reception and civic participation on YouTube. A case study of the documentary “Greece: The Hidden War”. Visual Communication. 24 (3).
Multimodality, ideology, and manipulation: BBC Travel documentaries and the Illusion of empire
Castaldi, J. 2025. Multimodality, ideology, and manipulation: BBC Travel documentaries and the Illusion of empire. New York Routledge.
Cognition, Relevance and Ideology Formation through Travel Documentaries: A Longitudinal Approach to Audiences
Castaldi, J. 2024. Cognition, Relevance and Ideology Formation through Travel Documentaries: A Longitudinal Approach to Audiences. Studies in Logic, Grammar and Rhetoric. 69 (1), pp. 113-137. https://doi.org/10.2478/slgr-2024-0010
Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources
Castaldi, J. 2024. Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources. Frontiers in Communication. 9, p. 1336325. https://doi.org/10.3389/fcomm.2024.1336325
Appendices for 'Multimodality, Ideology and Manipulation: BBC Travel Documentaries and the Illusion of Empire'
Castaldi, J. 2024. Appendices for 'Multimodality, Ideology and Manipulation: BBC Travel Documentaries and the Illusion of Empire'.
Approaching manipulation in current​ discourses: A growing interdisciplinary research​ endeavour
Castaldi, J. and Konieczna, E. 2024. Approaching manipulation in current​ discourses: A growing interdisciplinary research​ endeavour.
Between positivism and relativism: A critical realist approach to the analysis of multimodal texts
Castaldi, J. 2024. Between positivism and relativism: A critical realist approach to the analysis of multimodal texts.
The representation of the Ukrainian displaced people diaspora on British television: A multimodal critical discourse analysis
Castaldi, J. 2024. The representation of the Ukrainian displaced people diaspora on British television: A multimodal critical discourse analysis.
Technology and language learning: A multimodal perspective
Castaldi, J. 2024. Technology and language learning: A multimodal perspective.
What does the other look like? A critical multimodal analysis of the representation of otherness in British television programmes about Ukrainian Displaced People
Castaldi, J. 2024. What does the other look like? A critical multimodal analysis of the representation of otherness in British television programmes about Ukrainian Displaced People.
Keeping the myth of the British Empire alive: Combining a multimodal analysis of two BBC travel documentaries with audience research
Castaldi, J. 2024. Keeping the myth of the British Empire alive: Combining a multimodal analysis of two BBC travel documentaries with audience research. in: Zantides, E. and Andreou, S. (ed.) Semiotics and Visual Communication IV: Myths of Today Newcastle upon Tyne Cambridge Scholars Publishing. pp. 331-353
Integrating Relevance Theory and Critical Realism for the analysis of manipulation
Castaldi, J. 2024. Integrating Relevance Theory and Critical Realism for the analysis of manipulation.
Book review: Mari-Liis Madisson and Andreas Ventsel, Strategic Conspiracy Narratives: A Semiotic Approach
Castaldi, J. 2023. Book review: Mari-Liis Madisson and Andreas Ventsel, Strategic Conspiracy Narratives: A Semiotic Approach. Media, War & Conflict. 17 (1), pp. 139-141. https://doi.org/10.1177/17506352231212406
Review of Serafis (2023): Authoritarianism on the Front Page: Multimodal Discourse and Argumentation in Times of Multiple Crises in Greece
Castaldi, J. 2023. Review of Serafis (2023): Authoritarianism on the Front Page: Multimodal Discourse and Argumentation in Times of Multiple Crises in Greece. Journal of Language and Politics. 23 (1), pp. 138-141. https://doi.org/10.1075/jlp.23122.cas
Discussing the Greek civil war in digital agoras. An interdisciplinary approach to multimodal historical documentation.
Castaldi, J. and Foundouka, I. C. 2023. Discussing the Greek civil war in digital agoras. An interdisciplinary approach to multimodal historical documentation.
YouTube digital spaces: a form of contemporary global agora? A case study of the documentary Greece: the hidden war
Castaldi, J. 2023. YouTube digital spaces: a form of contemporary global agora? A case study of the documentary Greece: the hidden war.
Multisensory processing, affect and multimodal manipulation: A cognitive-semiotic empirical study of travel documentaries
Castaldi, J. 2023. Multisensory processing, affect and multimodal manipulation: A cognitive-semiotic empirical study of travel documentaries.
Cognition, relevance and ideology formation through travel documentaries: A longitudinal approach to audiences
Castaldi, J. 2023. Cognition, relevance and ideology formation through travel documentaries: A longitudinal approach to audiences.
Epistemic vigilance in travel documentaries: investigating top-down and bottom-up processes in multimodal manipulation
Castaldi, J. 2023. Epistemic vigilance in travel documentaries: investigating top-down and bottom-up processes in multimodal manipulation.
Beyond language: multimodal literacy and ELT. Opportunities and challenges
Castaldi, J. 2023. Beyond language: multimodal literacy and ELT. Opportunities and challenges.
Ideology and manipulation in travel documentaries: a cognitive-semiotic approach
Castaldi, J. 2022. Ideology and manipulation in travel documentaries: a cognitive-semiotic approach.
Cognition and ideological effects in the interaction between viewers and BBC travel documentaries: combining multimodal critical discourse analysis and audience research
Castaldi, J. 2022. Cognition and ideological effects in the interaction between viewers and BBC travel documentaries: combining multimodal critical discourse analysis and audience research.
Keeping the myth of the British Empire alive: combining a multi-semiotic analysis of two BBC travel documentaries with audience research
Castaldi, J. 2022. Keeping the myth of the British Empire alive: combining a multi-semiotic analysis of two BBC travel documentaries with audience research.
Political semiotics in non-political genres: investigating multimodal manipulation
Castaldi, J. 2022. Political semiotics in non-political genres: investigating multimodal manipulation.
Multimodal manipulation in travel documentaries: bypassing epistemic vigilance
Castaldi, J. 2021. Multimodal manipulation in travel documentaries: bypassing epistemic vigilance.
The British Empire in BBC travel documentaries: investigating multimodal manipulation
Castaldi, J. 2021. The British Empire in BBC travel documentaries: investigating multimodal manipulation.
Cognition and ideological effects in the interaction between viewers and BBC travel and cultural documentaries: combining multimodal critical discourse analysis and audience research
Castaldi, J. 2021. Cognition and ideological effects in the interaction between viewers and BBC travel and cultural documentaries: combining multimodal critical discourse analysis and audience research . PhD Thesis Canterbury Christ Church University Centre for Language and Linguistics
A multimodal analysis of the representation of the Rohingya crisis in BBC’s Burma with Simon Reeve (2018): Integrating Audience Research in Multimodal Critical Discourse Studies
Castaldi, Jacopo 2020. A multimodal analysis of the representation of the Rohingya crisis in BBC’s Burma with Simon Reeve (2018): Integrating Audience Research in Multimodal Critical Discourse Studies. Multimodal Communication. 10 (1), pp. 55-72. https://doi.org/10.1515/mc-2020-0014