Sound, vision & multisensory perception
Synesthesia: When Sound and Other Senses Intersect
What synesthesia is, how it differs from ordinary cross-modal association, imagery and metaphor, and why no sound visualisation can create or reproduce it.
10 min read
The short answer
Synesthesia is a condition in which a stimulus in one modality reliably and involuntarily triggers an additional experience, such as hearing a sound and also experiencing a specific colour. It is defined by consistency over time, involuntariness and idiosyncrasy: two sound-colour synesthetes rarely agree on which colour a given note evokes. Prevalence estimates from population screening are in the low single-digit percentages across all variants, and the sound-colour form is rarer still. Synesthesia is not the same as the cross-modal correspondences everyone shows, not the same as vivid mental imagery, and not the same as describing a tone as bright or warm. It is not known to be trainable in the full sense, and no audio-visual product, including SonicSenses, induces it or reproduces any individual's synesthetic experience.
Why this matters for sound and music
Synesthesia is the term most often borrowed by audiovisual marketing. Getting the boundaries right protects a genuinely interesting phenomenon from being flattened into a slogan, and keeps SonicSenses honest about what watching sound can and cannot be.
What counts as synesthesia
The working criteria in the research literature are fairly strict. The additional experience must be triggered automatically rather than deliberately, it must be consistent when re-tested unannounced months or years later, and it must be specific to the person. Consistency testing is the main empirical safeguard, because self-report alone cannot distinguish a synesthete from someone with a strong learned association or an evocative way of speaking.
Many variants exist. Grapheme-colour synesthesia - letters and digits carrying colours - is the most studied and most common. Sound-colour and music-colour forms are the ones relevant here, along with rarer variants involving taste, touch or spatial forms.
Prevalence figures vary by screening method and by which variants are counted. A widely cited population screening study, which used objective consistency testing rather than self-report, reported an overall figure in the low single digits, with individual variants substantially rarer.
- Involuntary
The extra experience arrives without being summoned.
- Consistent
The same trigger yields the same experience on unannounced retest.
- Idiosyncratic
Pairings differ between synesthetes; there is no shared map.
- Perceptual-like
Reported as an experience rather than as a knowledge or a metaphor.
Four things that are not synesthesia
Cross-modal correspondence comes first. Most people match higher pitches with higher positions, brighter colours, smaller sizes and sharper shapes. These are measurable, sometimes strong, and entirely ordinary. A prominent argument in the field is precisely that everyone showing correspondences does not make everyone weakly synesthetic, because correspondences lack the involuntary, idiosyncratic, experience-like quality that defines the condition.
Second is mental imagery. Vividly picturing a scene while listening to music is imagery, generated and modifiable by the listener. Synesthetic concurrents are not generated on request in that way.
Third is metaphor and language. Calling a violin tone bright or a bass warm is conventional cross-sensory vocabulary that most listeners share. Fourth is learned association: a colour attached to a song because of an album cover or a memory is real and can be stable, but it is acquired and traceable rather than automatic from early life.
- Correspondence: population-wide, measurable, not synesthesia.
- Imagery: voluntary and modifiable, not synesthesia.
- Metaphor: shared language about sound, not synesthesia.
- Learned association: acquired and often traceable to an event, not synesthesia.
What the neuroscience suggests, and how confident to be
Two families of explanation dominate. One proposes increased structural or functional connectivity between adjacent or related cortical areas; the other proposes reduced inhibition of connections that everyone has. Reviews describe evidence consistent with both and treat the question as unsettled rather than solved.
Work specifically on sound-colour synesthesia is informative for this section. Comparisons with non-synesthetes suggest that synesthetic pairings are not arbitrary: they partly follow the same regularities found in the wider population, such as higher pitches mapping to lighter colours. The most cautious reading is that synesthesia may be an unusually explicit and automatic expression of cross-modal mechanisms present in everyone, rather than a wholly separate faculty.
Sample sizes in this literature are small, since synesthetes are rare and objective verification is demanding. Individual imaging findings should be treated as suggestive.
What this means for sound visualisation
Audio-visual tools are frequently marketed with the word synesthesia. That usage is loose at best. A visualizer applies the same designed mapping to every viewer; synesthesia is individual, involuntary and internally generated. The two are not the same kind of thing, and one does not simulate the other.
SonicSenses does not induce synesthesia, does not train users to become synesthetes, and cannot reproduce any particular synesthete's experience. What it does is translate measured features of audio - level, frequency-band energy, spectral brightness, onsets and beat rate, stereo balance - into a visual form chosen for aesthetic and perceptual congruence.
Nor is synesthesia an enhancement to aspire to. Some studies report memory advantages tied narrowly to the synesthetic pairings themselves, but there is no good evidence that synesthesia confers general cognitive or intellectual advantage.
What we know
- Synesthesia is verifiable through consistency testing and is defined by involuntary, idiosyncratic additional experiences.
- Population screening places overall prevalence in the low single digits, with sound-colour variants rarer than grapheme-colour.
- Synesthetic sound-colour pairings partly follow cross-modal regularities found in non-synesthetes.
- Cross-modal correspondences in the general population are common and are distinct from synesthesia.
What remains uncertain
- Whether increased connectivity, reduced inhibition, or a combination best explains the condition.
- How much of the variation between synesthetes is developmental, genetic or learned.
- How reliably any laboratory training paradigm produces experiences that meet full synesthesia criteria - current evidence does not establish that it does.
What this does not prove
- That synesthesia can be induced by watching or listening to media.
- That SonicSenses creates, trains or simulates synesthesia.
- That synesthetes are more intelligent or more creative in a general sense.
- That everyone is 'a little bit synesthetic'.
Practical meaning
- If you see colours when you hear music, that is worth noticing, but a consistency test is what distinguishes synesthesia from vivid association.
- Enjoying a colour mapping in a visualizer is ordinary cross-modal congruence, not a synesthetic experience.
- Treat products promising to give you synesthesia as making an unsupported claim.
- Descriptions of another person's synesthesia are reports, not maps you can adopt.
Frequently asked questions
- What is synesthesia?
- A condition in which a stimulus reliably and involuntarily triggers an additional experience in another modality or dimension - for example, a heard tone also producing a specific colour. Researchers verify it by testing whether the same trigger produces the same concurrent on unannounced retest, because self-report alone cannot separate it from strong association.
- How common is synesthesia?
- Screening studies that use objective consistency testing report overall prevalence in the low single-digit percentages across all variants combined. Grapheme-colour is the most common form; sound-colour and music-colour variants are considerably rarer.
- Is seeing colours when I hear music the same as synesthesia?
- Not necessarily. Imagery, learned associations and ordinary cross-modal correspondences can all produce colour impressions during music. Synesthesia additionally requires that the experience be involuntary, consistent over time and specific to you.
- Can a visualizer give me synesthesia?
- No. There is no evidence that audiovisual media induce synesthesia, and a visualizer applies one designed mapping to everyone, whereas synesthetic pairings are individual and internally generated. SonicSenses does not induce, train or simulate synesthesia.
- Are synesthetes more creative or intelligent?
- There is no good evidence for a general advantage. Some memory benefits have been reported, but they tend to be narrow and tied to the synesthetic pairings themselves rather than reflecting broader cognitive superiority.
References & further reading
- Ward, J. (2013). Synesthesia. Annual Review of Psychology DOI: 10.1146/annurev-psych-113011-143840
- Simner, J., Mulvenna, C., Sagiv, N., Tsakanikos, E., Witherby, S. A., Fraser, C., ... & Ward, J. (2006). Synaesthesia: the prevalence of atypical cross-modal experiences. Perception DOI: 10.1068/p5469
- Ward, J., Huckstep, B., & Tsakanikos, E. (2006). Sound-colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all?. Cortex DOI: 10.1016/s0010-9452(08)70352-6
- Deroy, O., & Spence, C. (2013). Why we are not all synesthetes (not even weakly so). Psychonomic Bulletin & Review DOI: 10.3758/s13423-013-0387-2
- Hubbard, E. M., & Ramachandran, V. S. (2005). Neurocognitive mechanisms of synesthesia. Neuron DOI: 10.1016/j.neuron.2005.10.012
- Spence, C. (2011). Crossmodal correspondences: a tutorial review. Attention, Perception, & Psychophysics DOI: 10.3758/s13414-010-0073-7
Related articles
- Visualizing Sound: How the Brain Integrates What We Hear and See
The cornerstone article on audiovisual integration and correspondence.
- Psychoacoustics
How physical sound becomes perceived brightness, pitch and loudness.
- Music, Imagery & Creativity
Auditory and visual imagery during music, and what improvisation research shows.
This article is an educational summary of publicly available research and is not medical advice. It does not diagnose, treat, or cure any medical or psychiatric condition. Where evidence is emerging or mixed, we say so. Consult a qualified professional for personal guidance.