🎯Core Definition
A Distributed Inverted Index is the foundational data structure and distributed partitioning architecture supporting sub-10ms keyword search across billions of documents; mapping Terms to Posting Lists (ordered arrays of Document IDs, Term Frequencies, Positions, and Payloads), indices are distributed across clusters via Document Partitioning or Term Partitioning; when evaluating multi-term queries (`Term A AND Term B`), the engine utilizes Skip Lists or SIMD-accelerated instructions to jump across posting IDs for rapid intersection alongside Block-Max WAND (Weak AND) dynamic score pruning.
💡Use Cases
Web search engines (Google, Bing), distributed search clusters (Elasticsearch, OpenSearch, Tantivy), and e-commerce product catalogs.
⚡Key Problems Solved
Scanning billions of documents naively takes minutes; inverted indices turn full-text matching into constant-time hash lookups and integer list intersections, scaling throughput to tens of thousands of queries per second per node.