/4 min
Why Dense Retrieval Fails on Acronyms, IDs, and Code (and How Hybrid Fixes It)
Vector search misses exact terms like SKUs and error codes because embeddings blur rare tokens; a sparse channel restores exact-match signal.
Tag
2 posts.
Vector search misses exact terms like SKUs and error codes because embeddings blur rare tokens; a sparse channel restores exact-match signal.
Add sparse/keyword search to dense embeddings only when your eval shows lexical misses on IDs, rare terms, acronyms, code, or names.