Depth sonification simulator
Shareable demo for the depth sonification system. Press “Run the simulation” to start.
Lower threshold means more distant objects are sonified; higher threshold keeps only near objects.
Help
What you are hearing
The sound is built from the 16×16 depth frame. Each row maps to a pitch: objects higher in the frame produce higher (sharper) notes, and objects lower in the frame produce lower (deeper) notes.
In the right frame, red means near and blue means far.
Horizontal position controls stereo: if something is on the left, it will sound more in your left ear than the right (and vice‑versa).
Distance controls volume: farther objects are quieter; closer objects are louder. Try tilting the view up/down while standing still to hear the pitch shift between high and low objects.
If you hear nothing, it usually means there are no objects within the current threshold (or the volume is too low). Lower the threshold or move closer to a surface.
Threshold is a cutoff that decides what gets sonified: higher threshold means only near objects sound; lower threshold lets farther objects in.
Tip: stand still and use Shift + ↑/↓ to tilt the camera. It recenters when you move.
🖱️ Click screen to enable mouse look · Esc to release
Right map is 16×16 depth derived from the left view (red = near, blue = far).
You can get an idea of what it would be like to detect depth and positions without actually seeing — like the blind people we are working with.
Try closing your eyes and make it a game: walk through a corridor without colliding.