Skip to main content

Spring Deadline: Sunday, March 1 @ 11:59pm PT. Click here to apply.

Back to Research
Accepted to VecDB @ ICML 2025

Entropy-Based Dynamic Hybrid Retrieval for Adaptive Query Weighting in RAG Pipelines

John Richard Perez, James Zhou, Radley Le, Alexander Menchtchikov, Ryan Lagasse

Abstract

We introduce Dynamic Alpha Tuning (DAT), a dynamic model that adjusts the weighting coefficient between sparse and dense retrievers based on model confidence. DAT employs meta-learned schemes to adaptively skew contributions between retrieval methods. Our experimental results on HotPotQA and TriviaQA benchmarks show that this yields coverage and answer diversity advantages over static hybrid approaches. We also evaluate Bayesian methods, such as variational retrieval confidence and Monte Carlo dropout, as alternatives to estimate principled query-specific weighting.

Citation

John Richard Perez, James Zhou, Radley Le, Alexander Menchtchikov, Ryan Lagasse. "Entropy-Based Dynamic Hybrid Retrieval for Adaptive Query Weighting in RAG Pipelines". Accepted to VecDB @ ICML 2025.

Details

Conference
Accepted to VecDB @ ICML 2025
Authors
5 authors

Publish Your Research

Join Algoverse and work with world-class mentors to publish at top AI conferences.

Start Your Application