Audiovisual Simultaneity Judgements in Synaesthesia

Abstract Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes...

Full description

Saved in:
Bibliographic Details
Published inMultisensory research Vol. 34; no. 7; pp. 681 - 692
Main Authors Borgolte, Anna, Bransi, Ahmad, Seifert, Johanna, Toto, Sermin, Szycik, Gregor R, Sinke, Christopher
Format Journal Article
LanguageEnglish
Published Leiden|Boston Brill 12.05.2021
Online AccessGet full text
ISSN2213-4794
2213-4808
2213-4808
DOI10.1163/22134808-bja10050

Cover

Abstract Abstract Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.
AbstractList Abstract Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.
Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.
Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.
Author Seifert, Johanna
Sinke, Christopher
Toto, Sermin
Borgolte, Anna
Szycik, Gregor R
Bransi, Ahmad
Author_xml – sequence: 1
  givenname: Anna
  surname: Borgolte
  fullname: Borgolte, Anna
– sequence: 2
  givenname: Ahmad
  surname: Bransi
  fullname: Bransi, Ahmad
– sequence: 3
  givenname: Johanna
  surname: Seifert
  fullname: Seifert, Johanna
– sequence: 4
  givenname: Sermin
  surname: Toto
  fullname: Toto, Sermin
– sequence: 5
  givenname: Gregor R
  surname: Szycik
  fullname: Szycik, Gregor R
– sequence: 6
  givenname: Christopher
  surname: Sinke
  fullname: Sinke, Christopher
BackLink https://www.ncbi.nlm.nih.gov/pubmed/33984831$$D View this record in MEDLINE/PubMed
BookMark eNp9kD1PwzAQhi1UREvpD2BBHVlC_ZXYGauKT1ViKMyWnVzAleOU2EHqvydVm4Wht9zp9D738V6jkW88IHRL8AMhGVtQShiXWCZmqwnGKb5Ak0MvOTRHQy1yPkazELa4D0mFyMQVGjOWSy4ZmSC27Erb_NrQaTff2LpzUXuwcT9_68ovqMHHMLd-vtl7DSF-Q7D6Bl1W2gWYnfIUfT49fqxekvX78-tquU4My9OYSIKBlhVPmdYCDAVuCgk8Z2kmjCy0SMFgWmhmpOC5ZmmZYQ6a5QQXArKKTdH9ce6ubX66fruqbSjAuf7CpguKplQS0b_Le-ndSdqZGkq1a22t270aHu0F4igo2iaEFipV2KijbXxstXWKYHVwVQ2uqsHVniT_yGH4OWZxZExrnVPbpmt979QZ4g-OpIcc
CitedBy_id crossref_primary_10_3389_fpsyt_2024_1492266
Cites_doi 10.1523/JNEUROSCI.3444-09.2010
10.1016/j.brainres.2012.07.011
10.1080/13546805.2017.1287693
10.1002/aur.1633
10.1111/jnp.12006
10.1016/j.jneumeth.2006.07.012
10.1038/nn.2886
10.3758/CABN.4.3.335
10.1080/09647040802431946
10.1111/j.1600-0404.1995.tb07018.x
10.1016/j.cortex.2011.06.008
10.3758/BF03193329
10.1162/jocn.2006.18.9.1570
10.1523/JNEUROSCI.07-10-03215.1987
10.1007/BF01659311
10.1162/jocn.2008.21166
10.1111/j.1460-9568.2009.06673.x
10.1016/j.tics.2006.06.004
10.1016/S1364-6613(00)01571-0
10.1016/j.neuropsychologia.2011.11.001
10.1523/JNEUROSCI.1182-13.2013
10.3758/PP.70.6.955
10.1038/nrn1030
10.1068/p5469
10.1037/a0027339
10.1016/S0010-9452(08)70352-6
10.1016/j.neuroimage.2008.07.028
10.1038/nn1906
10.1007/s00221-010-2240-4
10.1523/JNEUROSCI.3501-09.2009
10.1016/j.neuropsychologia.2012.09.015
ContentType Journal Article
Copyright Copyright 2021 by Koninklijke Brill NV, Leiden, The Netherlands
Copyright_xml – notice: Copyright 2021 by Koninklijke Brill NV, Leiden, The Netherlands
DBID AAYXX
CITATION
NPM
7X8
DOI 10.1163/22134808-bja10050
DatabaseName CrossRef
PubMed
MEDLINE - Academic
DatabaseTitle CrossRef
PubMed
MEDLINE - Academic
DatabaseTitleList
PubMed
CrossRef
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
Discipline Psychology
EISSN 2213-4808
EndPage 692
ExternalDocumentID 33984831
10_1163_22134808_bja10050
Genre Journal Article
GroupedDBID .4S
3Q-
4.4
53G
AACRU
AAFNC
AAMSZ
AAOTM
AAXJT
ABDBF
ABIVO
ABJNI
ABJWF
ABMYL
ABNDG
ABNTP
ABUBZ
ACGFS
ACHQT
ACLGF
ACVUQ
ACWTZ
ADDNY
ADIZZ
ADMQJ
ADOBN
ADZLE
AEALX
AENEX
AEVUW
AEYCS
AFFNX
AHYGR
AJQST
AJUIR
ALJKW
ALMA_UNASSIGNED_HOLDINGS
AMFWP
AMUOF
AOGPY
ARCSS
BBTKD
EAP
EBC
EBD
EBS
EDO
EJD
EMK
EMOBN
EPL
EST
ESX
E~D
IY5
KAT
KOBVO
KWN
SV3
TUS
VG3
X4A
~FV
AAAXD
AAOGP
AAYXX
ABXFW
ACUHS
AEASU
CITATION
NPM
7X8
ID FETCH-LOGICAL-b395t-810e2df453aa7eb2e4bc8e493567b8ca75eb02ca3b8749a35d604ea3910c7e6f3
ISSN 2213-4794
2213-4808
IngestDate Fri Jul 11 04:21:30 EDT 2025
Mon Mar 03 15:01:18 EST 2025
Thu Apr 24 22:56:20 EDT 2025
Tue Jul 01 02:39:31 EDT 2025
Thu Mar 14 07:30:25 EDT 2024
IsPeerReviewed true
IsScholarly true
Issue 7
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-b395t-810e2df453aa7eb2e4bc8e493567b8ca75eb02ca3b8749a35d604ea3910c7e6f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0000-0003-1716-6229
0000-0002-8678-7419
0000-0001-9339-1191
PMID 33984831
PQID 2528174804
PQPubID 23479
PageCount 12
ParticipantIDs proquest_miscellaneous_2528174804
pubmed_primary_33984831
crossref_citationtrail_10_1163_22134808_bja10050
crossref_primary_10_1163_22134808_bja10050
brill_journals_10_1163_22134808_bja10050
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2021-May-12
PublicationDateYYYYMMDD 2021-05-12
PublicationDate_xml – month: 05
  year: 2021
  text: 2021-May-12
  day: 12
PublicationDecade 2020
PublicationPlace Leiden|Boston
PublicationPlace_xml – name: Leiden|Boston
– name: Netherlands
PublicationSubtitle A Journal of Scientific Research on All Aspects of Multisensory Processing
PublicationTitle Multisensory research
PublicationTitleAlternate Multisens Res
PublicationYear 2021
Publisher Brill
Publisher_xml – name: Brill
References Noel, J.-P. (R000022); 10
Zampini, M. (R000038); 67
Barnett, K. J. (R000002); 43
Foss-Feig, J. H. (R000009); 203
Ward, J. (R000036); 42
Esterman, M. (R000007); 18
O’Hanlon, E. (R000023); 4
van Eijk, R. L. J. (R000035); 70
Robertson, L. C. (R000026); 4
Powers, A. R. (R000025); 29
Weiss, P. H. (R000037); 21
Sinke, C. (R000032); 8
Cytowic, R. E. (R000004)
Jewanski, J. (R000014); 18
Nieuwenhuis, S. (R000020); 14
Sinke, C. (R000031); 50
Eagleman, D. M. (R000006); 159
Stevenson, R. A. (R000033); 38
Grossenbacher, P. G. (R000010); 5
Zerr, M. (R000039); 10
Noel, J.-P. (R000021); 11
Neufeld, J. (R000018); 1473
Jäncke, L. (R000013); 29
Meredith, M. A. (R000016); 7
Rouw, R. (R000027); 10
Pöppel, E. (R000024)
Haß, K. (R000011); 22
Rouw, R. (R000028); 30
Arrighi, R. (R000001); 6
Dixon, M. J. (R000005); 4
Hupé, J.-M. (R000012); 9
Mulvenna, C. M. (R000017); 10
Lehrl, S. (R000015); 91
Brang, D. (R000003); 48
Simner, J. (R000030); 35
Exner, S. (R000008); 11
Van der Burg, E. (R000034); 33
Shams, L. (R000029); 408
Neufeld, J. (R000019); 50
References_xml – volume: 30
  start-page: 6205
  ident: R000028
  article-title: Neural basis of individual differences in synesthetic experiences
  doi: 10.1523/JNEUROSCI.3444-09.2010
– volume: 408
  ident: R000029
  article-title: What you see is what you hear
– volume: 6
  ident: R000001
  article-title: Perceptual synchrony of audiovisual streams for natural and artificial motion sequences
– volume: 10
  ident: R000039
  article-title: Brief sensory training narrows the temporal binding window and enhances long-term multimodal speech perception
– volume: 1473
  start-page: 78
  ident: R000018
  article-title: Reduced audio–visual integration in synaesthetes indicated by the double-flash illusion
  doi: 10.1016/j.brainres.2012.07.011
– volume: 22
  start-page: 145
  ident: R000011
  article-title: Enlarged temporal integration window in schizophrenia indicated by the double-flash illusion
  doi: 10.1080/13546805.2017.1287693
– volume: 10
  start-page: 121
  ident: R000022
  article-title: Atypical rapid audio-visual temporal recalibration in autism spectrum disorders
  doi: 10.1002/aur.1633
– volume: 8
  start-page: 94
  ident: R000032
  article-title: Reduced audiovisual integration in synesthesia — evidence from bimodal speech perception
  doi: 10.1111/jnp.12006
– volume: 159
  start-page: 139
  ident: R000006
  article-title: A standardized test battery for the study of synesthesia
  doi: 10.1016/j.jneumeth.2006.07.012
– volume: 14
  start-page: 1105
  ident: R000020
  article-title: Erroneous analyses of interactions in neuroscience: a problem of significance
  doi: 10.1038/nn.2886
– volume: 11
  ident: R000021
  article-title: Audiovisual simultaneity judgment and rapid recalibration throughout the lifespan
– volume: 4
  start-page: 335
  ident: R000005
  article-title: Not all synaesthetes are created equal: projector versus associator synaesthetes
  doi: 10.3758/CABN.4.3.335
– volume: 18
  start-page: 293
  ident: R000014
  article-title: A colorful albino: the first documented case of synaesthesia, by Georg Tobias Ludwig Sachs in 1812
  doi: 10.1080/09647040802431946
– volume: 91
  start-page: 335
  ident: R000015
  article-title: Multiple choice vocabulary test MWT as a valid and short test to estimate premorbid intelligence
  doi: 10.1111/j.1600-0404.1995.tb07018.x
– volume: 48
  start-page: 630
  ident: R000003
  article-title: Grapheme-color synesthetes show enhanced crossmodal processing between auditory and visual modalities
  doi: 10.1016/j.cortex.2011.06.008
– volume: 67
  start-page: 531
  ident: R000038
  article-title: Audio-visual simultaneity judgments
  doi: 10.3758/BF03193329
– volume: 18
  start-page: 1570
  ident: R000007
  article-title: Coming unbound: disrupting automatic integration of synesthetic color and graphemes by transcranial magnetic stimulation of the right parietal lobe
  doi: 10.1162/jocn.2006.18.9.1570
– volume: 7
  start-page: 3215
  ident: R000016
  article-title: Determinants of multisensory integration in superior colliculus neurons. I. temporal factors
  doi: 10.1523/JNEUROSCI.07-10-03215.1987
– volume: 4
  ident: R000023
  article-title: Combined structural and functional imaging reveals cortical deactivations in grapheme-color synaesthesia
– volume: 11
  start-page: 403
  ident: R000008
  article-title: Experimentelle Untersuchung der einfachsten psychischen Processe
  doi: 10.1007/BF01659311
– volume: 21
  start-page: 2019
  ident: R000037
  article-title: Priming letters by colors: evidence for the bidirectionality of grapheme–color synesthesia
  doi: 10.1162/jocn.2008.21166
– volume: 29
  start-page: 1287
  ident: R000013
  article-title: The neuroanatomy of grapheme–color synesthesia
  doi: 10.1111/j.1460-9568.2009.06673.x
– volume: 10
  start-page: 350
  ident: R000017
  article-title: Synaesthesia: supernormal integration?
  doi: 10.1016/j.tics.2006.06.004
– volume: 5
  start-page: 36
  ident: R000010
  article-title: Mechanisms of synesthesia: cognitive and physiological constraints
  doi: 10.1016/S1364-6613(00)01571-0
– volume: 50
  start-page: 85
  ident: R000019
  article-title: The neural correlates of coloured music: a functional MRI investigation of auditory–visual synaesthesia
  doi: 10.1016/j.neuropsychologia.2011.11.001
– volume: 33
  start-page: 14633
  ident: R000034
  article-title: Rapid recalibration to audiovisual asynchrony
  doi: 10.1523/JNEUROSCI.1182-13.2013
– volume: 70
  start-page: 955
  ident: R000035
  article-title: Audiovisual synchrony and temporal order judgments: Effects of experimental method and stimulus type
  doi: 10.3758/PP.70.6.955
– volume: 9
  ident: R000012
  article-title: A critical review of the neuroimaging literature on synesthesia
– volume: 4
  start-page: 93
  ident: R000026
  article-title: Binding, spatial attention and perceptual awareness
  doi: 10.1038/nrn1030
– ident: R000004
– volume: 35
  start-page: 1024
  ident: R000030
  article-title: Synaesthesia: the prevalence of atypical cross-modal experiences
  doi: 10.1068/p5469
– volume: 38
  start-page: 1517
  ident: R000033
  article-title: Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions
  doi: 10.1037/a0027339
– volume: 42
  start-page: 264
  ident: R000036
  article-title: Sound-colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all?
  doi: 10.1016/S0010-9452(08)70352-6
– volume: 43
  start-page: 605
  ident: R000002
  article-title: Differences in early sensory-perceptual processing in synesthesia: a visual evoked potential study
  doi: 10.1016/j.neuroimage.2008.07.028
– volume: 10
  start-page: 792
  ident: R000027
  article-title: Increased structural connectivity in grapheme-color synesthesia
  doi: 10.1038/nn1906
– volume: 203
  start-page: 381
  ident: R000009
  article-title: An extended multisensory temporal binding window in autism spectrum disorders
  doi: 10.1007/s00221-010-2240-4
– volume: 29
  start-page: 12265
  ident: R000025
  article-title: Perceptual training narrows the temporal window of multisensory binding
  doi: 10.1523/JNEUROSCI.3501-09.2009
– volume: 50
  start-page: 3363
  ident: R000031
  article-title: Inside a synesthete’s head: a functional connectivity analysis with grapheme-color synesthetes
  doi: 10.1016/j.neuropsychologia.2012.09.015
– start-page: 24
  ident: R000024
  article-title: Taxonomie des Subjektiven auf der Grundlage eines pragmatischen Monismus
SSID ssj0000827767
Score 2.2554383
Snippet Abstract Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another...
Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory...
SourceID proquest
pubmed
crossref
brill
SourceType Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 681
Title Audiovisual Simultaneity Judgements in Synaesthesia
URI http://booksandjournals.brillonline.com/content/journals/10.1163/22134808-bja10050
https://www.ncbi.nlm.nih.gov/pubmed/33984831
https://www.proquest.com/docview/2528174804
Volume 34
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1La9wwEBbtBspeSt_dvnChh1Jwa-thycfdtiEE2ks2kJuRbLlx2bXD2ntIf31ntLLXoUloezHGlmSYTx7NSDPfEPJOpIWRsBKFFmZMyCUt4Z-TNCypLFMGSzxlmJz87XtydMqPz8TZvsCiyy7pzMf817V5Jf-DKjwDXDFL9h-QHQaFB3AP-MIVEIbrX2E832IsadViCshJhbGBurZoVh9vi11Mi4t2PbmsNSj_c9tWemyMuuTbFvxYPGf3rD_D7vCi2fxoVrvieciyPDp8r1sXAjA_X-ti2KGxGCPT-ehePeqwbFylJtRKa0_z7XcZaIwH5D6-2TptRGnMQq4iNdJ28fU6OEEuCGyPzUPzU8fIMjNuC2K8WDtQGEsVV34huEp83b-6Sw6oBMNoQg7miy-Lw2ELDawX5CLyZ9Xw2U9_fHRK7vXDgPdhNtVqddUAucGrcNbF8gG5792CYL7D-CG5Y-tHZDqsTpePCRuBHYzBDvZgB1UdjMF-Qk4Pvy4_H4W-4kVoWCq6UMWRpUXJBdNaWkMtN7myPGUikUblWgprIpprZpTkqWaiSCJuNQObL5c2KdlTMqmb2j4ngYgLQ0ub2xJMYl7EJuUx-NZWqBIZk8oZee_Ekfn53GbOHUxY1gsx64U4I1EvsSz3zPFYwGR1W5cPQ5eLHW3KbY3f9jBkoNzwxAoE2GzbjAqqwGVWEZ-RZzt8huF6XF_c-OYlme6n8isy6TZb-xpMyM688VPpN4F9a1w
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Audiovisual+Simultaneity+Judgements+in+Synaesthesia&rft.jtitle=Multisensory+research&rft.au=Borgolte%2C+Anna&rft.au=Bransi%2C+Ahmad&rft.au=Seifert%2C+Johanna&rft.au=Toto%2C+Sermin&rft.date=2021-05-12&rft.eissn=2213-4808&rft.spage=1&rft_id=info:doi/10.1163%2F22134808-bja10050&rft_id=info%3Apmid%2F33984831&rft.externalDocID=33984831
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2213-4794&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2213-4794&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2213-4794&client=summon