Visual Computing Systems ยท MobiSys 2019

Banner: An Image Sensor Reconfiguration Framework for Seamless Resolution-based Tradeoffs

Authors
Jinhan Hu, Alexander Shearer, Saranya Rajagopalan, Robert LiKamWa
Venue
MobiSys 2019 - The 17th International Conference on Mobile Systems, Applications, and Services

Banner rearchitects camera reconfiguration so mobile vision systems can adapt sensor resolution at runtime without the disruptive frame gaps that have traditionally made that tradeoff impractical.

Introduction: Making Resolution Adaptation Continuous

Mobile vision systems benefit from reducing resolution when imaging detail is unnecessary, but conventional systems pause frame delivery whenever the sensor changes modes. Banner makes resolution changes a practical runtime decision by eliminating the visible interruption in the stream.

Resolution and energy tradeoff for mobile visual sensing
Figure 1. Lower resolution reduces sensing cost, while higher resolution preserves visual detail.

System Architecture: Reconfiguring Without a Frame Gap

Banner modifies common media frameworks such as V4L2 with two techniques: parallel reconfiguration prepares a new sensor mode while an application processes the current stream, and format-oblivious memory management reuses buffers across resolutions.

Comparison of legacy and Banner resolution reconfiguration pipelines
Figure 2. Banner reduces the sequential work needed to change sensor resolution.
Banner parallel reconfiguration strategy
Figure 3. Parallel reconfiguration overlaps preparation of the next mode with the current stream.
Banner format-oblivious memory management
Figure 4. Format-oblivious memory management reuses buffers across sensor resolutions.

Results: Faster Transitions, Lower Energy

Banner reduces frame-to-frame resolution-switch latency from 226 ms to 33 ms and cuts end-to-end reconfiguration time to 105 ms. This enables continuous vision applications to pursue lower-power sensing strategies without sacrificing seamless frame delivery.

Banner evaluation results for resolution reconfiguration latency and power
Figure 5. Banner reduces reconfiguration latency and enables energy savings through dynamic resolution selection.