Presentation
Hero: Adaptive Orchestration of Retrieval-Augmented Generation on Heterogeneous Mobile SoC
DescriptionHeRo is a framework for efficiently running agentic RAG on resource-limited, heterogeneous mobile devices. It builds a performance model that accounts for workload, accelerator features, and memory contention, then uses a lightweight, dependency-guided scheduler with shape-aware decomposition, criticality estimation, and concurrency control. This approach adapts to dynamic workloads and significantly reduces latency, achieving up to 10.94× speedup over prior methods.
Event Type
Research Manuscript
TimeTuesday, July 2810:43am - 10:56am PDT
LocationMtg Room 101B