M9-012M9: Senior ML & AI System DesignLLM Serving, RAG & Agent SysDesignHard
⚡Flashcard Drill➔Mastery:
Design a Zero-Leak Multi-Tenant RBAC Enterprise Hybrid RAG Hub
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Guarantee strict enterprise access isolation inside retrieval via filterable HNSW traversal paired with Docling layout parsing and idempotent CDC indexing.
📌 Key Takeaways
- •L1 Security Invariant: enforce group ACLs mathematically at retrieval time, never via system prompt wishes
- •L2 Docling + Small-to-Big: preserve full table Markdown alongside dense 200-token retrieval keys
- •L2 Filterable HNSW: evaluate tenant bitmasks inside graph search and auto-switch to filtered SIMD at <5% selectivity
- •L3 Verifiable UX: link exact answer spans to source snippets with egress neutralization
📐 Mathematical Derivations
Dynamically switching highly selective (<5%) ACL queries from HNSW traversal to roaring-bitmap SIMD scan preserves 100% recall safely.
🏭 Production Trade-offs
Store fast-mutating IAM group memberships separately or as hot-patched payloads so org shifts never trigger re-embedding.
⚠️ Common Interview Pitfalls
- ✕Prompt-based pseudo access control broken cleanly by indirect injection
- ✕Fixed-char splitting breaks table structure and aligns wrong columns
🎯 Interviewer Follow-up Inquiries
- ?How do Okta group revocations enforce retrieval cutoff within 5 seconds?
- ?What safe abstention UX handles zero-hit pre-filtered searches cleanly?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚