🎨 Synesthesia & the Psychoacoustics of Emotion

About this simulation

Chromesthesia is a form of synesthesia in which sounds — usually pitch and timbre — automatically and involuntarily evoke perceived colors. Synesthetes consistently pair specific tones with specific hues, much like the "color circles" proposed by Isaac Newton and later Alexander Scriabin, who assigned a color to each of the twelve pitch classes. But even people without synesthesia show strikingly consistent, measurable emotional responses to a piece of music's tempo, mode (major vs. minor), and timbre — the psychoacoustic building blocks this lab lets you manipulate directly.

How it works

• Each note played is placed on the pitch-color wheel at its pitch class position and rises or falls along a spiral as the melody's contour moves through the scale.
• Major mode sends the melody spiraling upward — the classic cross-cultural signature of "bright," positive-valence music. Minor mode sends it sinking downward, associated with sadness or gravity.
• Tempo drives both the spawn rate of notes and the physiological arousal reading — faster tempi read as more energetic/tense, slower as calmer.
• Timbre reshapes each note's geometry from smooth and rounded (mellow, warm) to angular and faceted (bright, buzzy) — a rough visual analogue of harmonic content.
• Toggling Synesthesia view off strips the color mapping, showing what a non-synesthete's raw auditory experience looks like: the same structure, no automatic color.

Controls

• Tempo — beats per minute of the generated melody (40–180 BPM).
• Mode — major or minor scale, the single strongest driver of perceived happiness/sadness in music-emotion research.
• Timbre — brightness of the tone color, from mellow/round to sharp/buzzy.
• Root note — shifts which pitch class (and therefore which color, on the chromesthesia wheel) the scale is built from.
• 🎨 Synesthesia view — toggles the automatic sound→color mapping on or off.

Did you know?

Studies of the "Bouba/Kiki" effect and infant looking-time experiments suggest cross-modal correspondences between pitch, brightness, and sharpness may be present from early in life — chromesthesia may simply be an unusually strong, conscious version of a mapping most brains make quietly all the time.