Presentation
MIRAGE: Runtime Scheduling for Multi-Vector Image Retrieval with Hierarchical Decomposition
DescriptionTo leverage user-specific data, retrieval-augmented generation (RAG) is used in multimodal large language model (MLLM) applications. Conventional retrieval has low accuracy, and advanced multi-vector retrieval (MVR) still lacks optimal accuracy and efficiency due to ignored query-image alignment and redundant image segments. We propose MIRAGE, an efficient image retrieval framework. It uses a hierarchical paradigm for better alignment, cuts redundancy by leveraging cross-hierarchy ranking consistency and hierarchy sparsity, and auto-configures dataset parameters. Experiments show it boosts accuracy and reduces computation by up to 3.5 times versus existing MVR systems.
Event Type
Research Manuscript
TimeWednesday, July 292:21pm - 2:34pm PDT
LocationMtg Room 101B
Similar Presentations