Spatial Computing ยท HotMobile 2019

Immersive Spatial Audio From the IoT

Authors
Robert LiKamWa, Frank Wencheng Liu
Venue
HotMobile 2019 - The 20th International Workshop on Mobile Computing Systems and Applications

Immersive Spatial Audio from the IoT rethinks commodity smart speakers as a coordinated acoustic system, placing virtual sound throughout a room without specialized spatial-audio hardware.

Introduction: Spatial Sound for Everyday Smart Spaces

IoT hubs normally produce sound from a single physical location, limiting how smart-home, AR, and VR systems can communicate. This project explores how a room of existing speakers can instead produce an immersive spatial-audio experience.

Illustration of distributed spatial audio in an IoT environment
Figure 1. A distributed speaker arrangement creates a spatial audio field in the room.

System Architecture: Coordinated Distributed Playback

The system uses immersive tracking and time-domain dynamic crosstalk cancellation to coordinate multiple speakers. Precise timing and amplitude adjustments position virtual sources relative to the listener while adapting to the user and environment.

Impact: More Contextual Smart-Environment Interaction

Spatial audio can make notifications, guidance, and virtual objects feel tied to their intended place rather than to a single hub. The approach points toward lower-cost, lower-maintenance immersive audio built from the IoT devices already present in a space.