Presentation
SCOUT: Thermal-Aware SRAM Allocation for Real-Time DNN Tasks on Edge TPU
DescriptionSpecialized hardware accelerators facilitate timing guarantees for real-time DNNs, but high computational demands cause severe thermal stress. We present SCOUT, a real-time framework for Google Edge TPU that jointly satisfies timing/thermal constraints. The key idea couples task-level dynamic frequency scaling (DFS) with runtime on-chip SRAM allocation to offset DFS-induced performance loss. To this end, SCOUT provides i) a thermal model that reflects SRAM's thermal impact and ii) an SRAM reallocation technique that safely adjusts allocations while mitigating write overheads. Our experiments show SCOUT schedules up to 46% more DNN task sets than prior approaches, while adhering to thermal constraints.
Event Type
Research Manuscript
TimeWednesday, July 2912:03pm - 12:16pm PDT
LocationMtg Room 203C