Depth sonification simulator

Shareable demo for the depth sonification system. Press “Run the simulation” to start.

Threshold

Lower threshold means more distant objects are sonified; higher threshold keeps only near objects.

Volume 100%
Use WASD to move · arrows to rotate Auto threshold enabled
? Help

What you are hearing

The sound is built from the 16×16 depth frame. Each row maps to a pitch: objects higher in the frame produce higher (sharper) notes, and objects lower in the frame produce lower (deeper) notes.

In the right frame, red means near and blue means far.

Horizontal position controls stereo: if something is on the left, it will sound more in your left ear than the right (and vice‑versa).

Distance controls volume: farther objects are quieter; closer objects are louder. Try tilting the view up/down while standing still to hear the pitch shift between high and low objects.

If you hear nothing, it usually means there are no objects within the current threshold (or the volume is too low). Lower the threshold or move closer to a surface.

Threshold is a cutoff that decides what gets sonified: higher threshold means only near objects sound; lower threshold lets farther objects in.

Maze camera (first-person)

Tip: stand still and use Shift + ↑/↓ to tilt the camera. It recenters when you move.

🖱️ Click screen to enable mouse look · Esc to release

Depth frame (16×16)

Right map is 16×16 depth derived from the left view (red = near, blue = far).

You can get an idea of what it would be like to detect depth and positions without actually seeing — like the blind people we are working with.

1
Start the demo Press the button to activate audio and the simulation.
2
Move around W/S or ↑/↓ forward/back · A/D strafe · ←/→ rotate.
3
Tilt the view When standing still, hold Shift + ↑/↓ to look up or down.
4
Listen Depth becomes sound. Headphones are highly recommended for stereo cues.

Try closing your eyes and make it a game: walk through a corridor without colliding.

W A S D ← →