Modality switching and negation: ERP evidence for modality-specific simulations during negation processing

Conference paper


Hald, L., Hocking, I., Marshall, J., Vernon, D. and Garnham, A. 2011. Modality switching and negation: ERP evidence for modality-specific simulations during negation processing.
AuthorsHald, L., Hocking, I., Marshall, J., Vernon, D. and Garnham, A.
TypeConference paper
Description

The Perceptual Symbol System Theory of cognition (Barsalou, 1999) suggests that modality-specific simulations underlie representation of concepts. This is evidenced by processing costs for switching modalities. That is, participants are slower to verify a property in the auditory modality (e.g., BLENDER-loud) after verifying a property in a different modality (e.g., CRANBERRIES-tart) and faster when verifying a property in the same modality (e.g., LEAVES-rustling). The modality switch cost has also been shown to lead to a modulation of the N400 event-related potential (ERP) (Collins, Pecher, Zeelenberg & Coulson, 2011 using a property verification task; Hald, Marshall, Janssen & Garnham, 2011 using a sentence verification task).

In a separate line of research, ERP studies have indicated that without a discourse context, negated sentences are more difficult to process than affirmative sentences, leading to a different N400 pattern for negative sentences than for affirmative sentences (e.g., Fischler, Bloom, Childers, Roucos, & Perry, 1983.) Unlike affirmative sentences, sentences containing negation show a larger N400 for correct, semantically coherent single sentences (i.e., factually true sentences) than for semantically incorrect sentences (i.e., false sentences). However, Nieuwland and Kuperberg (2008,) found that the pragmatics of the sentence can change this N400 pattern to one closer to affirmative sentences.

The goal of the current study was to explore whether the processing of negation could be aided by modality matching information. Other evidence suggests that comprehenders create a simulation of negative sentences (Kaup, Yaxley, Madden, Zwaan, & Lüdtke, 2007), but it is unclear whether modality matching information could modulate the processing cost of negation. Essentially, can modality matching information as reported by Collins et al., (2011) and Hald et al., (2011) lead to a modulation of the N400 for true negated sentences similar to that seen when discourse pragmatics supports negation? Furthermore, we were interested in whether the modality switch effect would lead to a similar pattern in the ERPs as that found with affirmative sentences (Collins et al., 2011 & Hald et al., 2011).

Using a within-subjects design we used 160 pairs of experimental pairs which were either of the same or of a different modality. All experimental items were either visual or tactile modality and were drawn from existing sets of materials (Pecher, et al., 2003; Van Dantzig, et al., 2008). For example, a different modality pair was “A light bulb is very hot” followed by “Rice isn’t black” versus a same visual modality pair “A giraffe is spotted” followed by “Rice isn’t black”. We predicted that the underlined word is where a modulation in the N400 may be seen. Additionally, we explored veracity by making half of the experimental target sentences false (“Rice isn’t white”). Participants were asked to judge whether each sentence was typically true or false.

Our initial results indicate a modulation in the ERP based on both modality and veracity. For true (“Rice isn’t black”) and false target statements (“Rice isn’t white”) different modality pairs elicit a larger frontal-central N400 like effect compared to same modality pairs (Figure 1), replicating Hald et al., (2011). When comparing true versus false, the different modality pairs elicit a large posterior N400 for true compared to false sentences (replicating the effect for negated sentences, i.e., Fischler et al., 1983). However for same modality pairs there is a reduction in the N400 to true statements; no difference is seen between true and false statements in the ERP (Figure 2).

These results replicate and extend previous ERP findings using the modality switch paradigm. The evidence suggests that not only do modality-specific simulations occur but they can even aid the processing of negation.

Year2011
ConferenceEmbodied and Situated Language Processing
Publication process dates
Deposited24 Oct 2012
Output statusPublished
Publisher's version
Permalink -

https://repository.canterbury.ac.uk/item/86qv6/modality-switching-and-negation-erp-evidence-for-modality-specific-simulations-during-negation-processing

  • 7
    total views
  • 0
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Sustainability in the workplace and the theory of planned behaviour: Norms and identity predict environmentally friendly intentions
Nigbur, D., Fernandez, A., Coen, S., Franz, A. and Hocking, I. 2020. Sustainability in the workplace and the theory of planned behaviour: Norms and identity predict environmentally friendly intentions.
Measuring precognitive effects using a fast implicit and fast explicit task
Vernon, D. 2019. Measuring precognitive effects using a fast implicit and fast explicit task.
A test of telepathy using immersive virtual reality
Vernon, D., Sandford, T. and Moyo, E. 2019. A test of telepathy using immersive virtual reality.
Portrait of an artist as collaborator: an interpretative phenomenological analysis of an artist
Hocking, I. 2019. Portrait of an artist as collaborator: an interpretative phenomenological analysis of an artist. Frontiers in Psychology. 10 (251), pp. 1-10. https://doi.org/10.3389/fpsyg.2019.00251
Testing precognition using a novel computer driving game
Vernon, D. and Ivencevic, L. 2018. Testing precognition using a novel computer driving game.
Precognitive priming of compound remote associates: using an implicit creative insight task to elicit precognition
Vernon, D. 2018. Precognitive priming of compound remote associates: using an implicit creative insight task to elicit precognition.
Test of reward contingent precall
Vernon, D. 2018. Test of reward contingent precall. Journal of Parapsychology. 82 (1), pp. 8-23. https://doi.org/10.30891/jopar.2018.01.02.
Further explorations of enhancing creative problem solving via structured thinking techniques
Hocking, I. and Vernon, D. 2017. Further explorations of enhancing creative problem solving via structured thinking techniques.
The right tool for the right task: structured techniques prove less effective on an ill-defined problem finding task
Hocking, I. and Vernon, D. 2017. The right tool for the right task: structured techniques prove less effective on an ill-defined problem finding task. Thinking Skills and Creativity. 26, pp. 84-91. https://doi.org/10.1016/j.tsc.2017.08.001
Testing to see whether participants with high levels of belief in psi can precall highly emotive images
Vernon, D. 2017. Testing to see whether participants with high levels of belief in psi can precall highly emotive images.
Attempting to elicit a precall effect using emotive images and participants with high levels of belief in psi
Vernon, D. 2017. Attempting to elicit a precall effect using emotive images and participants with high levels of belief in psi. Journal of Consciousness Studies. 24 (11-12), pp. 216-237.
Exploring the effect of a contingent cash based reward on the precall of arousing images
Vernon, D. 2017. Exploring the effect of a contingent cash based reward on the precall of arousing images.
How to win the lottery: Can using precall help in radomized prize draws?
Vernon, D. 2017. How to win the lottery: Can using precall help in radomized prize draws? Paranormal Review. Spring (82), p. 23.
The golden path: first steps in establishing order for two creative problem solving techniques
Hocking, I. and Vernon, D. 2017. The golden path: first steps in establishing order for two creative problem solving techniques. Edinburgh Napier University
Enhancing creative problem solving and creative self-efficacy: a preliminary study
Dempster, T., Hocking, I., Vernon, D. and Snyder, H. 2017. Enhancing creative problem solving and creative self-efficacy: a preliminary study. Edinburgh Napier University
Exploring precall using arousing images and utilising a memory recall practise task on-line
Vernon, D. 2017. Exploring precall using arousing images and utilising a memory recall practise task on-line. Journal of the Society for Psychical Research.
A bridge too far: conceptual distance and creative ideation
Hocking, I. and Vernon, D. 2017. A bridge too far: conceptual distance and creative ideation. Creativity: Theories, Research, Applications. 4 (2), pp. 333-352. https://doi.org/10.1515/ctra-2017-0017
A matter of perspective: the impact of near and far conceptual distance on creative problem solving
Hocking, I. and Vernon, D. 2016. A matter of perspective: the impact of near and far conceptual distance on creative problem solving.
Which cues work best? An examination of two structured thinking tools using eye-tracking analysis
Hocking, I., Vernon, D., Rehal, N. and Valkova, M. 2016. Which cues work best? An examination of two structured thinking tools using eye-tracking analysis.
Exploring precall using arousing images and utilising a memory recall practice task on-line
Vernon, D. 2016. Exploring precall using arousing images and utilising a memory recall practice task on-line.
Either here or there: exploring conceptual distance using a novel clock face paradigm in a creative problem solving task
Vernon, D. and Hocking, I. 2016. Either here or there: exploring conceptual distance using a novel clock face paradigm in a creative problem solving task.
Six Thinking Hats vs. Six Good Men: does the order of the elements matter?
Vernon, D. and Hocking, I. 2016. Six Thinking Hats vs. Six Good Men: does the order of the elements matter?
Behavioural evolution: Darwin's theory and adaptive behaviour
Osthaus, B. and Hocking, I. 2016. Behavioural evolution: Darwin's theory and adaptive behaviour. CCCU Science Society Talk. The Foundry, Canterbury, UK 25 May 2016 CCCU Science Society.
The influence of self-regulation technique on the efficiency of voluntary increasing alpha power training
Bazanova, O., Lazareva, O. and Vernon, D. 2014. The influence of self-regulation technique on the efficiency of voluntary increasing alpha power training.
Neurofeedback: reviewing the methodology
Bazanova, O. and Vernon, D. 2014. Neurofeedback: reviewing the methodology.
Comparing the effectiveness of subliminal single-word, and multi-word primes on working memory performance
Reeves, S. and Vernon, D. 2014. Comparing the effectiveness of subliminal single-word, and multi-word primes on working memory performance.
An evidence-based review of creative problem solving tools: a practitioner’s resource
Vernon, D., Hocking, I. and Tyler, T. 2016. An evidence-based review of creative problem solving tools: a practitioner’s resource. Human Resource Development Review. https://doi.org/10.1177/1534484316641512
Beyond belief: structured techniques prove more effective than a placebo intervention in a problem construction task
Vernon, D. and Hocking, I. 2016. Beyond belief: structured techniques prove more effective than a placebo intervention in a problem construction task. Thinking Skills and Creativity. 19, pp. 153-159. https://doi.org/10.1016/j.tsc.2015.10.009
Solaris and 'the other' [in Eye on fiction: the alien in us all]
Hocking, I. 2015. Solaris and 'the other' [in Eye on fiction: the alien in us all]. The Psychologist. 28 (10), pp. 808-811.
Applying structured techniques in a problem construction task
Hocking, I. and Vernon, D. 2015. Applying structured techniques in a problem construction task. University of Toronto
Thinking hats and good men: structured techniques in a problem finding task
Hocking, I. and Vernon, D. 2014. Thinking hats and good men: structured techniques in a problem finding task. University of Nottingham
Have you tried 'brain breathing'? Structured thinking and problem construction
Hocking, I. and Vernon, D. 2015. Have you tried 'brain breathing'? Structured thinking and problem construction. University of Kent
Exploring precognition using a repetition priming paradigm
Vernon, D. 2015. Exploring precognition using a repetition priming paradigm. Journal of the Society for Psychical Research. 79 (2) (919), pp. 65-79.
Interpreting EEG alpha activity
Bazanova, O. and Vernon, D. 2014. Interpreting EEG alpha activity. Neuroscience and Biobehavioral Reviews. 44, pp. 94-110. https://doi.org/10.1016/j.neubiorev.2013.05.007
Comparing structured thinking tools on a problem construction task using an ill-defined problem
Vernon, D. and Hocking, I. 2015. Comparing structured thinking tools on a problem construction task using an ill-defined problem. University of Kent
Thinking hats and good men: structured techniques in a problem construction task
Vernon, D. and Hocking, I. 2014. Thinking hats and good men: structured techniques in a problem construction task. Thinking Skills and Creativity. 14, pp. 41-46. https://doi.org/10.1016/j.tsc.2014.07.001
Asymmetric activation of the anterior cerebral cortex in recipients of IRECA: preliminary evidence for the energetic effects of an intention-based treatment modality on human neurophysiology.
Pike, C., Vernon, D. and Hald, L. 2014. Asymmetric activation of the anterior cerebral cortex in recipients of IRECA: preliminary evidence for the energetic effects of an intention-based treatment modality on human neurophysiology. Journal of Alternative and Complementary Medicine. 20 (10), pp. 780-786. https://doi.org/10.1089/acm.2014.0074
Exploring modality switching effects in negated sentences: further evidence for grounded representations
Hald, L., Hocking, I., Vernon, D., Marshall, J. and Garnham, A. 2013. Exploring modality switching effects in negated sentences: further evidence for grounded representations. Frontiers in Psychology. 4. https://doi.org/10.3389/fpsyg.2013.00093
Spatial cognition and perseveration by horses, donkeys and mules in a simple A-not-B detour task
Osthaus, B., Proops, L., Hocking, I. and Burden, F. 2013. Spatial cognition and perseveration by horses, donkeys and mules in a simple A-not-B detour task. Animal Cognition. 16 (2), pp. 301-305. https://doi.org/10.1007/s10071-012-0589-4
Tracking EEG changes to alpha and beta binaural beats
Vernon, D., Peryer, G., Louch, J. and Shaw, M. 2014. Tracking EEG changes to alpha and beta binaural beats. International Journal of Psychophysiology. 93 (1), pp. 134-139. https://doi.org/10.1016/j.ijpsycho.2012.10.008
A novel self-guided approach to alpha activity training using water based electrodes
Van Boxtel, G., Denissen, A., Jager, M., Vernon, D., Dekker, M., Mihajlovic, V. and Sitskoorn, M. 2012. A novel self-guided approach to alpha activity training using water based electrodes. International Journal of Psychophysiology. 83 (3), pp. 282-294. https://doi.org/10.1016/j.ijpsycho.2011.11.004
The human computer
Hocking, I. 2002. The human computer. in: Chorlton, W. (ed.) Thinking and Knowing London Brown Partworks.
Artificial minds
Hocking, I. 2002. Artificial minds. in: Chorlton, W. (ed.) The Brain and the Mind London Brown Partworks.
Down to the wire: a short introduction to artificial intelligence
Hocking, I. 2012. Down to the wire: a short introduction to artificial intelligence. Thirst eDitions.
The theory of planned behaviour, self-identity, and moral disengagement: what predicts sustainability at work?
Nigbur, D., Coen, S., Fernandez, A., Franz, A. and Hocking, I. 2012. The theory of planned behaviour, self-identity, and moral disengagement: what predicts sustainability at work?
Neurofeedback: refining the methodology of brain-computer interface training.
Vernon, D. and Dempster, T. 2012. Neurofeedback: refining the methodology of brain-computer interface training. in: Orsucci, F. and Sala, N. (ed.) Complexity Science, Living Systems and Reflexing Interfaces: New Models and Perspectives Hershey, PA, USA. Idea Group Inc. pp. 92-111
The essence of nationhood: how ordinary people make sense of nationality, and how essentialist beliefs create acculturative problems
Nigbur, D., Franz, A., Hocking, I., Hilton, D., Charalambides, L., Zagefka, H., Gonzalez, R. and Tip, L. 2012. The essence of nationhood: how ordinary people make sense of nationality, and how essentialist beliefs create acculturative problems.
Human potential: exploring techniques used to enhance human performance
Vernon, D. 2009. Human potential: exploring techniques used to enhance human performance. London Routledge.
The effects of distinct training schedules on participants’ ability to alter alpha activity via neurofeedback: a preliminary study
Vernon, D. and Dempster, T. 2008. The effects of distinct training schedules on participants’ ability to alter alpha activity via neurofeedback: a preliminary study.
Neurofeedback as a mechanism to enhance the performance of healthy participants
Vernon, D. 2009. Neurofeedback as a mechanism to enhance the performance of healthy participants.
What aspects of context are relevant for negation processing? An event-related potential study
Hald, L., Marshall, J. and Garnham, A. 2009. What aspects of context are relevant for negation processing? An event-related potential study.
What constitutes a relevant context for processing negation? An event-related potential study
Hald, L., Marshall, J. and Garnham, A. 2009. What constitutes a relevant context for processing negation? An event-related potential study.
EEG biofeedback as a mechanism to enhance performance
Vernon, D. 2010. EEG biofeedback as a mechanism to enhance performance.
Refining the methodology of alpha NFT and exploring its effect on cognition and mood
Vernon, D. 2010. Refining the methodology of alpha NFT and exploring its effect on cognition and mood.
Refining the methodology of EEG biofeedback
Vernon, D. 2010. Refining the methodology of EEG biofeedback.
EEG biofeedback and optimal performance
Vernon, D. 2010. EEG biofeedback and optimal performance.
Cortical habituation of schizotypal individuals: a differential pattern for unreality subtypes
Gruzelier, J., Vernon, D., Haenschel, C. and Dwivedi, P. 2002. Cortical habituation of schizotypal individuals: a differential pattern for unreality subtypes. International Journal of Psychophysiology. 45 (1-2), p. 79.
Validating the efficacy of neurofeedback for optimising performance
Gruzelier, J., Egner, T. and Vernon, D. 2006. Validating the efficacy of neurofeedback for optimising performance. Progress in Brain Research. 159, pp. 421-431. https://doi.org/10.1016/S0079-6123(06)59027-2
Theories and issues in child development
Slater, A., Hocking, I. and Loose, J. 2003. Theories and issues in child development. in: Slater, A. and Bremner, G. (ed.) An Introduction to Developmental Psychology Oxford Blackwell. pp. 34-62
The effect of distinct neurofeedback training protocols on working memory, mental rotation and attention
Vernon, D., Egner, T., Cooper, N., Compton, T., Neilands, C., Sheri, A. and Gruzelier, J. 2004. The effect of distinct neurofeedback training protocols on working memory, mental rotation and attention. Journal of Neurotherapy. 8 (1), pp. 83-102.
Neurofeedback as a treatment for ADHD: a methodological review with implications for future research
Vernon, D., Frick, A. and Gruzelier, J. 2004. Neurofeedback as a treatment for ADHD: a methodological review with implications for future research. Journal of Neurotherapy. 8 (2), pp. 53-82. https://doi.org/10.1300/J184v08n02_04
The role of colour in implicit and explicit memory performance
Vernon, D. and Lloyd-Jones, T. 2003. The role of colour in implicit and explicit memory performance. The Quarterly Journal of Experimental Psychology: Section A. 56 (5), pp. 779-802. https://doi.org/10.1080/02724980244000684
The effect of training distinct neurofeedback protocols on aspects of cognitive performance
Vernon, D., Egner, T., Cooper, N., Compton, T., Neilands, C., Sheri, A. and Gruzelier, J. 2003. The effect of training distinct neurofeedback protocols on aspects of cognitive performance. International Journal of Psychophysiology. 47 (1), pp. 75-85. https://doi.org/10.1016/S0167-8760(02)00091-0
Semantic interference from visual object recognition on visual imagery
Lloyd-Jones, T. and Vernon, D. 2003. Semantic interference from visual object recognition on visual imagery. Journal of Experimental Psychology: Learning, Memory, and Cognition. 29 (4), pp. 563-580. https://doi.org/10.1037/0278-7393.29.4.563
Dynamics of metacognitive judgments: Pre- and postretrieval mechanisms.
Vernon, D. and Usher, M. 2003. Dynamics of metacognitive judgments: Pre- and postretrieval mechanisms. Journal of Experimental Psychology: Learning, Memory, and Cognition. 29 (3), pp. 339-346. https://doi.org/10.1037/0278-7393.29.3.339
Slow habituation of induced gamma and beta oscillations in association with unreality experiences in schizotypy
Vernon, D., Haenschel, C., Dwivedi, P. and Gruzelier, J. 2005. Slow habituation of induced gamma and beta oscillations in association with unreality experiences in schizotypy. International Journal of Psychophysiology. 56 (1), pp. 15-24. https://doi.org/10.1016/j.ijpsycho.2004.09.012
Event-related brain potential correlates of human auditory sensory memory-trace formation
Haenschel, C., Vernon, D., Dwivedi, P., Gruzelier, J. and Baldewig, T. 2005. Event-related brain potential correlates of human auditory sensory memory-trace formation. Journal of Neuroscience. 25 (45), pp. 10494-10501. https://doi.org/10.1523/JNEUROSCI.1227-05.2005
Can neurofeedback training enhance performance? An evaluation of the evidence with implications for future research
Vernon, D. 2005. Can neurofeedback training enhance performance? An evaluation of the evidence with implications for future research. Applied Psychophysiology and Biofeedback. 30 (4), pp. 347-364. https://doi.org/10.1007/s10484-005-8421-4
Neurofeedback: using computer technology to alter brain functioning
Vernon, D. 2008. Neurofeedback: using computer technology to alter brain functioning. in: Orsucci, F. and Sala, N. (ed.) Reflexing Interfaces: The Complex Coevolution of Information Technology Ecosystems Hershey, Pennsylvania, USA IGI Global. pp. 94-108
Alpha neurofeedback training for performance enhancement: reviewing the methodology
Vernon, D., Dempster, T., Bazanova, O., Rutterford, N., Pasqualini, M. and Andersen, S. 2009. Alpha neurofeedback training for performance enhancement: reviewing the methodology. Journal of Neurotherapy. 13 (4), pp. 214-227. https://doi.org/10.1080/10874200903334397
Domestic cats (Felis catus) do not show causal understanding in a string-pulling task
Whitt, E., Douglas, M., Osthaus, B. and Hocking, I. 2009. Domestic cats (Felis catus) do not show causal understanding in a string-pulling task. Animal Cognition. 12 (5), pp. 739-743. https://doi.org/10.1007/s10071-009-0228-x
Effects of delay on color priming for natural objects
Vernon, D. and Lloyd-Jones, T. 2007. Effects of delay on color priming for natural objects. Psychological Reports. 100 (1), pp. 275-293. https://doi.org/10.2466/PR0.100.1.275-293
Identifying indices of learning for alpha neurofeedback training
Dempster, T. and Vernon, D. 2009. Identifying indices of learning for alpha neurofeedback training. Applied Psychophysiology and Biofeedback. 34 (4), pp. 309-328. https://doi.org/10.1007/s10484-009-9112-3
Electroencephalographic biofeedback as a mechanism to alter mood, creativity and artistic performance
Vernon, D. and Gruzelier, J. 2008. Electroencephalographic biofeedback as a mechanism to alter mood, creativity and artistic performance. in: De Luca, B. (ed.) Mind-Body and Relaxation Research Focus New York, USA Nova Science Publishers. pp. 149-164