Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources

Journal article

Castaldi, J. 2024. Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources. Frontiers in Communication. 9, p. 1336325. https://doi.org/10.3389/fcomm.2024.1336325
AuthorsCastaldi, J.
AbstractThe issue of defining key concepts in multimodal research is at the same time ongoing and of pivotal importance. Building on John Bateman’s categorisation of modes, and paying special attention to the concept of materiality within the discussion, the paper provides a clear differentiation between semiotic modes and semiotic resources and discusses the relationship between the two. These will be defined by also looking at how they differ from another key concept in multimodal research, i.e., media, and examples will be provided to illustrate how the newly defined concepts can guide empirical investigations of multimodal texts and their reception. The paper aims to continue the discussions around these key concepts amongst multimodal scholars, so that agreement in the field can eventually be reached.
Keywordssemiotic resources; materiality; empirical multimodality research; media; semiotic modes
Year2024
JournalFrontiers in Communication
Journal citation9, p. 1336325
PublisherFrontiers Media S.A.
ISSN2297-900X
Digital Object Identifier (DOI)https://doi.org/10.3389/fcomm.2024.1336325
Official URLhttps://www.frontiersin.org/articles/10.3389/fcomm.2024.1336325/full
Publication dates
Online19 Mar 2024
Publication process dates
Deposited25 Mar 2024
Accepted06 Mar 2024
Publisher's version
File Access Level
Open
Output statusPublished
Additional information

Publications router: Date 2024-03-06 of type 'accepted_date' included in notification.
Publications router: Date 2024-03-19 of type 'publication_date' with format 'electronic' included in notification
Publications router: Date 2023-11-10 of type 'received' included in notification
Publications router: Date 2024-01-01 of type 'collection' included in notification
Publications router: Date 2024-03-06 of type 'accepted' included in notification
Publications router: Date 2024-03-19 of type 'epub' included in notification

Publications router: License for this article: http://creativecommons.org/licenses/by/4.0/ included in notification

Licensehttp://creativecommons.org/licenses/by/4.0/
Permalink -

https://repository.canterbury.ac.uk/item/976y1/refining-concepts-for-empirical-multimodal-research-defining-semiotic-modes-and-semiotic-resources

Download files

Publisher's version
Castaldi (2024) Refining concepts for empirical multimodal research. Defining semiotic modes and semiotic resources.pdf
File access level: Open

  • 41
    total views
  • 15
    total downloads
  • 1
    views this month
  • 1
    downloads this month

Export as

Related outputs

Appendices for 'Multimodality, Ideology and Manipulation: BBC Travel Documentaries and the Illusion of Empire'
Castaldi, J. 2024. Appendices for 'Multimodality, Ideology and Manipulation: BBC Travel Documentaries and the Illusion of Empire'.
Approaching manipulation in current​ discourses: A growing interdisciplinary research​ endeavour
Castaldi, J. and Konieczna, E. 2024. Approaching manipulation in current​ discourses: A growing interdisciplinary research​ endeavour.
Between positivism and relativism: A critical realist approach to the analysis of multimodal texts
Castaldi, J. 2024. Between positivism and relativism: A critical realist approach to the analysis of multimodal texts.
The representation of the Ukrainian displaced people diaspora on British television: A multimodal critical discourse analysis
Castaldi, J. 2024. The representation of the Ukrainian displaced people diaspora on British television: A multimodal critical discourse analysis.
Technology and language learning: A multimodal perspective
Castaldi, J. 2024. Technology and language learning: A multimodal perspective.
What does the other look like? A critical multimodal analysis of the representation of otherness in British television programmes about Ukrainian Displaced People
Castaldi, J. 2024. What does the other look like? A critical multimodal analysis of the representation of otherness in British television programmes about Ukrainian Displaced People.
Keeping the myth of the British Empire alive: Combining a multimodal analysis of two BBC travel documentaries with audience research
Castaldi, J. 2024. Keeping the myth of the British Empire alive: Combining a multimodal analysis of two BBC travel documentaries with audience research. in: Zantides, E. and Andreou, S. (ed.) Semiotics and Visual Communication IV: Myths of Today Newcastle upon Tyne Cambridge Scholars Publishing. pp. 331-353
Integrating Relevance Theory and Critical Realism for the analysis of manipulation
Castaldi, J. 2024. Integrating Relevance Theory and Critical Realism for the analysis of manipulation.
Book review: Mari-Liis Madisson and Andreas Ventsel, "Strategic Conspiracy Narratives: A Semiotic Approach"
Castaldi, J. 2023. Book review: Mari-Liis Madisson and Andreas Ventsel, "Strategic Conspiracy Narratives: A Semiotic Approach". Media, War & Conflict. 17 (1), pp. 139-141. https://doi.org/10.1177/17506352231212406
Review of Serafis (2023): Authoritarianism on the Front Page: Multimodal Discourse and Argumentation in Times of Multiple Crises in Greece
Castaldi, J. 2023. Review of Serafis (2023): Authoritarianism on the Front Page: Multimodal Discourse and Argumentation in Times of Multiple Crises in Greece. Journal of Language and Politics. 23 (1), pp. 138-141. https://doi.org/10.1075/jlp.23122.cas
Discussing the Greek civil war in digital agoras. An interdisciplinary approach to multimodal historical documentation.
Castaldi, J. and Foundouka, I. C. 2023. Discussing the Greek civil war in digital agoras. An interdisciplinary approach to multimodal historical documentation.
YouTube digital spaces: a form of contemporary global agora? A case study of the documentary Greece: the hidden war
Castaldi, J. 2023. YouTube digital spaces: a form of contemporary global agora? A case study of the documentary Greece: the hidden war.
Multisensory processing, affect and multimodal manipulation: A cognitive-semiotic empirical study of travel documentaries
Castaldi, J. 2023. Multisensory processing, affect and multimodal manipulation: A cognitive-semiotic empirical study of travel documentaries.
Cognition, relevance and ideology formation through travel documentaries: A longitudinal approach to audiences
Castaldi, J. 2023. Cognition, relevance and ideology formation through travel documentaries: A longitudinal approach to audiences.
Epistemic vigilance in travel documentaries: investigating top-down and bottom-up processes in multimodal manipulation
Castaldi, J. 2023. Epistemic vigilance in travel documentaries: investigating top-down and bottom-up processes in multimodal manipulation.
Beyond language: multimodal literacy and ELT. Opportunities and challenges
Castaldi, J. 2023. Beyond language: multimodal literacy and ELT. Opportunities and challenges.
Ideology and manipulation in travel documentaries: a cognitive-semiotic approach
Castaldi, J. 2022. Ideology and manipulation in travel documentaries: a cognitive-semiotic approach.
Cognition and ideological effects in the interaction between viewers and BBC travel documentaries: combining multimodal critical discourse analysis and audience research
Castaldi, J. 2022. Cognition and ideological effects in the interaction between viewers and BBC travel documentaries: combining multimodal critical discourse analysis and audience research.
Keeping the myth of the British Empire alive: combining a multi-semiotic analysis of two BBC travel documentaries with audience research
Castaldi, J. 2022. Keeping the myth of the British Empire alive: combining a multi-semiotic analysis of two BBC travel documentaries with audience research.
Political semiotics in non-political genres: investigating multimodal manipulation
Castaldi, J. 2022. Political semiotics in non-political genres: investigating multimodal manipulation.
Multimodal manipulation in travel documentaries: bypassing epistemic vigilance
Castaldi, J. 2021. Multimodal manipulation in travel documentaries: bypassing epistemic vigilance.
The British Empire in BBC travel documentaries: investigating multimodal manipulation
Castaldi, J. 2021. The British Empire in BBC travel documentaries: investigating multimodal manipulation.
Cognition and ideological effects in the interaction between viewers and BBC travel and cultural documentaries: combining multimodal critical discourse analysis and audience research
Castaldi, J. 2021. Cognition and ideological effects in the interaction between viewers and BBC travel and cultural documentaries: combining multimodal critical discourse analysis and audience research . PhD Thesis Canterbury Christ Church University Centre for Language and Linguistics
A multimodal analysis of the representation of the Rohingya crisis in BBC’s Burma with Simon Reeve (2018): Integrating Audience Research in Multimodal Critical Discourse Studies
Castaldi, Jacopo 2020. A multimodal analysis of the representation of the Rohingya crisis in BBC’s Burma with Simon Reeve (2018): Integrating Audience Research in Multimodal Critical Discourse Studies. Multimodal Communication. 10 (1), pp. 55-72. https://doi.org/10.1515/mc-2020-0014