Multisensory processing, affect and multimodal manipulation: Investigating travel documentaries

Book chapter


Castaldi, J. 2025. Multisensory processing, affect and multimodal manipulation: Investigating travel documentaries. in: Feeling, Skill and Knowledge: Semiotics of the Subject in Environment, Culture and World Cham Springer Nature. pp. 37-48
AuthorsCastaldi, J.
Abstract

This paper explores the subject’s embodied relationship with the media environment by looking at the aspects of multisensory processing and affect within the field of empirical multimodal research. More specifically, a sample analysis from a case study is offered to highlight how affect, engaged with through the multisensorial experience of a travel documentary viewer, plays a role in facilitating the successful deployment of manipulative discourse. The key concepts of manipulation and epistemic vigilance are discussed before providing a review of findings from the neurosciences and their relevance to the study of affect in empirical multimodal research. A sample analysis is then offered to exemplify the line of enquiry adopted, with the suggestion that, in travel documentaries, successful manipulative discourse relies not only on “limiting the processes of contextual selection” (Maillat and Oswald, 2009: 361), but also on limiting the emotional response of the viewer, predominantly through the music mode. Possible venues for future research are discussed in the conclusion.

KeywordsMultisensory processing; Affect; Social semiotics; Empirical multimodal research; Multimodal manipulation; Relevance theory; Epistemic vigilance; Critical discourse studies; Audience research; Travel documentaries
Page range37-48
Year2025
Book titleFeeling, Skill and Knowledge: Semiotics of the Subject in Environment, Culture and World
PublisherSpringer Nature
Output statusPublished
File
File Access Level
Restricted
Place of publicationCham
ISBN9783031959981
Publication dates
Print01 Oct 2025
Publication process dates
Accepted11 Jun 2025
Deposited08 Oct 2025
Digital Object Identifier (DOI)https://doi.org/10.1007/978-3-031-95999-8_4
Official URLhttps://link.springer.com/chapter/10.1007/978-3-031-95999-8_4
Permalink -

https://repository.canterbury.ac.uk/item/9w2q1/multisensory-processing-affect-and-multimodal-manipulation-investigating-travel-documentaries

  • 49
    total views
  • 1
    total downloads
  • 4
    views this month
  • 0
    downloads this month

Export as

Related outputs

The multimodal construction of empathy in the representation of Ukrainian displaced people: The case of British television
Castaldi, J. 2025. The multimodal construction of empathy in the representation of Ukrainian displaced people: The case of British television.
Multimodal discourse reception: ​Approaches and methods
Castaldi, J. and Bucher, H.-J. 2025. Multimodal discourse reception: ​Approaches and methods.
Linguistics, media discourse and multimodality
Castaldi, J. 2025. Linguistics, media discourse and multimodality.
Integrating multimodality and reception studies for research in the humanities and social sciences
Castaldi, J. 2025. Integrating multimodality and reception studies for research in the humanities and social sciences.
Multimodality and reception studies
Castaldi, J. 2025. Multimodality and reception studies. Visual Communication. 24 (3). https://doi.org/10.1177/14703572251331136
Multimodality, AI and pedagogy: A framework for empirical precision
Castaldi, J. 2025. Multimodality, AI and pedagogy: A framework for empirical precision.
Investigating ideology, manipulation, and text interpretation in documentary films
Castaldi, J. 2025. Investigating ideology, manipulation, and text interpretation in documentary films.
Investigating multimodality, reception and civic participation on YouTube. A case study of the documentary “Greece: The Hidden War”
Castaldi, J. and Foundouka, I. 2025. Investigating multimodality, reception and civic participation on YouTube. A case study of the documentary “Greece: The Hidden War”. Visual Communication. 24 (3).
Multimodality, ideology, and manipulation: BBC Travel documentaries and the Illusion of empire
Castaldi, J. 2025. Multimodality, ideology, and manipulation: BBC Travel documentaries and the Illusion of empire. New York Routledge.
Cognition, Relevance and Ideology Formation through Travel Documentaries: A Longitudinal Approach to Audiences
Castaldi, J. 2024. Cognition, Relevance and Ideology Formation through Travel Documentaries: A Longitudinal Approach to Audiences. Studies in Logic, Grammar and Rhetoric. 69 (1), pp. 113-137. https://doi.org/10.2478/slgr-2024-0010
Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources
Castaldi, J. 2024. Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources. Frontiers in Communication. 9, p. 1336325. https://doi.org/10.3389/fcomm.2024.1336325
Appendices for 'Multimodality, Ideology and Manipulation: BBC Travel Documentaries and the Illusion of Empire'
Castaldi, J. 2024. Appendices for 'Multimodality, Ideology and Manipulation: BBC Travel Documentaries and the Illusion of Empire'.
Approaching manipulation in current​ discourses: A growing interdisciplinary research​ endeavour
Castaldi, J. and Konieczna, E. 2024. Approaching manipulation in current​ discourses: A growing interdisciplinary research​ endeavour.
Between positivism and relativism: A critical realist approach to the analysis of multimodal texts
Castaldi, J. 2024. Between positivism and relativism: A critical realist approach to the analysis of multimodal texts.
The representation of the Ukrainian displaced people diaspora on British television: A multimodal critical discourse analysis
Castaldi, J. 2024. The representation of the Ukrainian displaced people diaspora on British television: A multimodal critical discourse analysis.
Technology and language learning: A multimodal perspective
Castaldi, J. 2024. Technology and language learning: A multimodal perspective.
What does the other look like? A critical multimodal analysis of the representation of otherness in British television programmes about Ukrainian Displaced People
Castaldi, J. 2024. What does the other look like? A critical multimodal analysis of the representation of otherness in British television programmes about Ukrainian Displaced People.
Keeping the myth of the British Empire alive: Combining a multimodal analysis of two BBC travel documentaries with audience research
Castaldi, J. 2024. Keeping the myth of the British Empire alive: Combining a multimodal analysis of two BBC travel documentaries with audience research. in: Zantides, E. and Andreou, S. (ed.) Semiotics and Visual Communication IV: Myths of Today Newcastle upon Tyne Cambridge Scholars Publishing. pp. 331-353
Integrating Relevance Theory and Critical Realism for the analysis of manipulation
Castaldi, J. 2024. Integrating Relevance Theory and Critical Realism for the analysis of manipulation.
Book review: Mari-Liis Madisson and Andreas Ventsel, Strategic Conspiracy Narratives: A Semiotic Approach
Castaldi, J. 2023. Book review: Mari-Liis Madisson and Andreas Ventsel, Strategic Conspiracy Narratives: A Semiotic Approach. Media, War & Conflict. 17 (1), pp. 139-141. https://doi.org/10.1177/17506352231212406
Review of Serafis (2023): Authoritarianism on the Front Page: Multimodal Discourse and Argumentation in Times of Multiple Crises in Greece
Castaldi, J. 2023. Review of Serafis (2023): Authoritarianism on the Front Page: Multimodal Discourse and Argumentation in Times of Multiple Crises in Greece. Journal of Language and Politics. 23 (1), pp. 138-141. https://doi.org/10.1075/jlp.23122.cas
Discussing the Greek civil war in digital agoras. An interdisciplinary approach to multimodal historical documentation.
Castaldi, J. and Foundouka, I. C. 2023. Discussing the Greek civil war in digital agoras. An interdisciplinary approach to multimodal historical documentation.
YouTube digital spaces: a form of contemporary global agora? A case study of the documentary Greece: the hidden war
Castaldi, J. 2023. YouTube digital spaces: a form of contemporary global agora? A case study of the documentary Greece: the hidden war.
Multisensory processing, affect and multimodal manipulation: A cognitive-semiotic empirical study of travel documentaries
Castaldi, J. 2023. Multisensory processing, affect and multimodal manipulation: A cognitive-semiotic empirical study of travel documentaries.
Cognition, relevance and ideology formation through travel documentaries: A longitudinal approach to audiences
Castaldi, J. 2023. Cognition, relevance and ideology formation through travel documentaries: A longitudinal approach to audiences.
Epistemic vigilance in travel documentaries: investigating top-down and bottom-up processes in multimodal manipulation
Castaldi, J. 2023. Epistemic vigilance in travel documentaries: investigating top-down and bottom-up processes in multimodal manipulation.
Beyond language: multimodal literacy and ELT. Opportunities and challenges
Castaldi, J. 2023. Beyond language: multimodal literacy and ELT. Opportunities and challenges.
Ideology and manipulation in travel documentaries: a cognitive-semiotic approach
Castaldi, J. 2022. Ideology and manipulation in travel documentaries: a cognitive-semiotic approach.
Cognition and ideological effects in the interaction between viewers and BBC travel documentaries: combining multimodal critical discourse analysis and audience research
Castaldi, J. 2022. Cognition and ideological effects in the interaction between viewers and BBC travel documentaries: combining multimodal critical discourse analysis and audience research.
Keeping the myth of the British Empire alive: combining a multi-semiotic analysis of two BBC travel documentaries with audience research
Castaldi, J. 2022. Keeping the myth of the British Empire alive: combining a multi-semiotic analysis of two BBC travel documentaries with audience research.
Political semiotics in non-political genres: investigating multimodal manipulation
Castaldi, J. 2022. Political semiotics in non-political genres: investigating multimodal manipulation.
Multimodal manipulation in travel documentaries: bypassing epistemic vigilance
Castaldi, J. 2021. Multimodal manipulation in travel documentaries: bypassing epistemic vigilance.
The British Empire in BBC travel documentaries: investigating multimodal manipulation
Castaldi, J. 2021. The British Empire in BBC travel documentaries: investigating multimodal manipulation.
Cognition and ideological effects in the interaction between viewers and BBC travel and cultural documentaries: combining multimodal critical discourse analysis and audience research
Castaldi, J. 2021. Cognition and ideological effects in the interaction between viewers and BBC travel and cultural documentaries: combining multimodal critical discourse analysis and audience research . PhD Thesis Canterbury Christ Church University Centre for Language and Linguistics
A multimodal analysis of the representation of the Rohingya crisis in BBC’s Burma with Simon Reeve (2018): Integrating Audience Research in Multimodal Critical Discourse Studies
Castaldi, Jacopo 2020. A multimodal analysis of the representation of the Rohingya crisis in BBC’s Burma with Simon Reeve (2018): Integrating Audience Research in Multimodal Critical Discourse Studies. Multimodal Communication. 10 (1), pp. 55-72. https://doi.org/10.1515/mc-2020-0014