For Acquisition, Partnership, or Investment InquiriesLearn more
SonicSenses

Hear it. See it. Understand it.

Explore how properties of sound can be measured, represented visually and perceived. Pick a concept below to see what you can listen for, what SonicSenses actually measures and draws from it, and what auditory science does - and does not - establish.

This is an educational guide. It is not therapy, diagnosis, neurofeedback, brain training or hearing rehabilitation, and nothing here measures neural activity. A visualisation shows a measurement taken from an audio signal, not a picture of your brain.

Five layers, kept separate

Every module below moves through the same chain. Each step is a different kind of thing, and collapsing them is where most popular sound science goes wrong.

  1. Step 1SoundA pressure wave in air
  2. Step 2MeasurementA number computed from the signal
  3. Step 3Visual mappingThat number drives a drawing
  4. Step 4PerceptionWhat a person experiences
  5. Step 5InterpretationWhat research supports

Choose a concept

Energy and loudness

Energy is how much the air pressure is moving overall. SonicSenses measures it as a smoothed RMS amplitude and uses it to drive overall brightness and motion.

A waveform envelope rising and falling, with a smoothed line tracking the peaks above it, illustrating how amplitude is averaged into an energy value.

Hear it

  • A track getting louder or quieter overall.
  • The difference between a sparse verse and a full chorus.
  • Sudden drops to near-silence.

See it

What is measured: Root-mean-square amplitude of the time-domain waveform, smoothed with a fast attack and slower release, plus a rolling dynamic-range estimate and an automatic sensitivity stage that normalises quiet microphone or tab captures.

  • Overall luminosity and the amount of motion in each visual world scale with this energy value.
  • A rolling minimum and maximum give a dynamic-range value, so a track that stays flat looks calmer than one that swings.
  • When the source is effectively silent, the visuals settle rather than freeze.

Understand it

  • Amplitude is a physical property of the pressure wave. Loudness is what a listener experiences, and the relationship between the two is compressive rather than linear.
  • Perceived loudness also depends on frequency content and duration, which is why two signals with identical amplitude can sound unequally loud.
  • Automatic sensitivity means the visual response reflects relative level within the current material, not an absolute decibel measurement. SonicSenses is not a sound-level meter.

Keep separate: Amplitude is not perceived loudness.

Learn more

All concepts at a glance

  • Energy and loudness

    Energy is how much the air pressure is moving overall. SonicSenses measures it as a smoothed RMS amplitude and uses it to drive overall brightness and motion.

    Amplitude is not perceived loudness.

  • Frequency and pitch

    SonicSenses splits the spectrum into six bands, from roughly 20 Hz to 16 kHz, and different bands drive different visual behaviours.

    Frequency is not pitch, and acoustic hertz is not a brainwave.

  • Spectral character and timbre

    The centre of gravity of the spectrum gives a single brightness number, which shifts the visual character between dark and luminous.

    A visualisation is a representation of a measurement, not the sound itself.

  • Rhythm, transients and beat

    SonicSenses detects onsets by comparing a fast and a slow energy envelope, then estimates an approximate beat rate from the spacing between them.

    Detecting onsets is signal processing. Feeling a beat is perception.

  • Stereo and spatial movement

    When the source is a media element, SonicSenses splits the channels and compares their levels to produce a left-right position value.

    Channel balance in a file is not the same as where a sound is heard in space.

  • Sound and vision together

    When visuals move in time with what you hear, the two senses are combined into a single impression. That is ordinary multisensory perception, not training.

    Synchrony is not neuroplasticity, and activation is not durable change.

What this page is not

  • It does not measure, display or infer brain activity.
  • It does not claim that watching visuals trains hearing, improves cognition or changes the brain.
  • It is not therapy, diagnosis, neurofeedback or hearing rehabilitation.
  • The visuals are a representation of numbers computed from an audio signal. Two different sounds can produce similar visuals.

Want the deeper science? Sound & the Plastic Brain rates the evidence behind every claim in this area. To try the visuals themselves, open the Visualizer.

This article is an educational summary of publicly available research and is not medical advice. It does not diagnose, treat, or cure any medical or psychiatric condition. Where evidence is emerging or mixed, we say so. Consult a qualified professional for personal guidance.