M9-012M9: Senior ML & AI System DesignLLM Serving, RAG & Agent SysDesignHard
⚡Flashcard Drill➔Mastery:

Design a Zero-Leak Multi-Tenant RBAC Enterprise Hybrid RAG Hub

🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
Next: M9-013 →
📐 Mathematical Definition
ACL_Match(u,d)⊆HNSW_PreFilter  ⟹  Leakage=0\text{ACL\_Match}(u, d) \subseteq \text{HNSW\_PreFilter} \implies \text{Leakage} = 0
⚡ One-Sentence Core Answer
Guarantee strict enterprise access isolation inside retrieval via filterable HNSW traversal paired with Docling layout parsing and idempotent CDC indexing.

📌 Key Takeaways

  • •
    L1 Security Invariant: enforce group ACLs mathematically at retrieval time, never via system prompt wishes
  • •
    L2 Docling + Small-to-Big: preserve full table Markdown alongside dense 200-token retrieval keys
  • •
    L2 Filterable HNSW: evaluate tenant bitmasks inside graph search and auto-switch to filtered SIMD at <5% selectivity
  • •
    L3 Verifiable UX: link exact answer spans to source snippets with egress neutralization

📐 Mathematical Derivations

Dynamically switching highly selective (<5%) ACL queries from HNSW traversal to roaring-bitmap SIMD scan preserves 100% recall safely.

🏭 Production Trade-offs

Store fast-mutating IAM group memberships separately or as hot-patched payloads so org shifts never trigger re-embedding.
⚠️ Common Interview Pitfalls
  • ✕
    Prompt-based pseudo access control broken cleanly by indirect injection
  • ✕
    Fixed-char splitting breaks table structure and aligns wrong columns
🎯 Interviewer Follow-up Inquiries
  • ?
    How do Okta group revocations enforce retrieval cutoff within 5 seconds?
  • ?
    What safe abstention UX handles zero-hit pre-filtered searches cleanly?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
🎯 Drill This Card Now➔
📚

Associated Knowledge Base Guides & Mindmaps

← PreviousM9-011: Design a 100K-QPS LLM Gateway (PD Disaggregation, Prefix Routing & Semantic Cache)📋 Back to BankNext →M9-013: Design a Durable Checkpointable & Idempotent Multi-Agent Execution Harness