AI Roadmap/Layer 08 · 08. AI Engineering / RAG / Agent / Orchestration
8.1

8.1 Retrieval-Augmented Generation & Knowledge Engineering

Hybrid search (BM25+Dense), RRF ranking fusion, cross-encoder rerankers, parent-child context expansion, GraphRAG entity extractors, ACL filters, and citation grounding.

Enterprise Hybrid RAG, Reranking & GraphRAG

BM25 inverted lexical search + dense vector retrieval fused via Reciprocal Rank Fusion (RRF), Cross-Encoder rerankers, Parent-Child chunk expansion, HyDE, and Microsoft GraphRAG hierarchical community summarization.

🏢 Companies
LlamaIndexLangChainMicrosoft Research (GraphRAG)HaystackPinecone
🛠️ Tech Stack
Hybrid SearchRRFCross-EncoderParent-Child ChunkingGraphRAGHyDELlamaIndexLangChain
💼 Roles & Salary
RAG Engineer、AI Engineer、Search Engineer
💰 $205K - $430K / year (Advanced RAG & GraphRAG) | ¥580K - ¥1.35M / year
📚 Prerequisites: BM25 & Dense Hybrid Search Fundamentals • RRF Score Normalization Mathematics • Cross-Encoder vs Bi-Encoder Complexity Trade-offs • Graph Entity Extraction & Leiden Community Clustering
🔍【Mini-Sandbox】Hybrid Search & RRF Fusion
BM25 keyword search + HNSW dense vector top-100 fused via Reciprocal Rank Fusion (RRF), re-scored by BGE Cross-Encoder for Top-3 precision.

Enterprise RAG ACL Security, Citations & Groundedness Evals

Multi-tenant organizational file ACL security pre-filtering, sentence-level citation footnotes, groundedness and faithfulness evaluations, and automated graceful retrieval fallbacks.

🏢 Companies
LlamaIndexLangChainDify.aiAzure AI SearchPinecone
🛠️ Tech Stack
RAG ACLMetadata FilteringCitationsGroundednessFaithfulnessHallucination DetectionRagas
💼 Roles & Salary
RAG Engineer、AI Engineer、Evaluation Engineer
💰 $195K - $410K / year (Enterprise RAG Governance & ACL) | ¥520K - ¥1.22M / year
📚 Prerequisites: RBAC/ABAC Metadata Security in Vector Stores • Sentence Citation Attribution & Context Budgeting • Ragas Groundedness & Faithfulness Metrics • Low-Confidence Fallbacks & Hallucination Prevention