M9-004M9: Senior ML & AI System DesignRecSys, Ads & Search ArchitectureMedium
⚡Flashcard Drill➔Mastery:

Design an E-Commerce Semantic + Lexical Product Search & Re-Ranking Engine

🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
Next: M9-005 →
📐 Mathematical Definition
RRF(d)=∑rwr60+rankr(d)∧RelScore(q,d)≥τgate\text{RRF}(d) = \sum_{r} \frac{w_r}{60 + \text{rank}_r(d)}\quad \land \quad \text{RelScore}(q,d) \ge \tau_{\text{gate}}
⚡ One-Sentence Core Answer
Combine NER slot pre-filtering (zero wrong-SKU errors) with BM25+Vector RRF hybrid retrieval and relevance-gated GMV ranking.

📌 Key Takeaways

  • •
    L1 Precision vs Recall: fuzzy generalization for broad intents vs zero tolerance for wrong SKU numbers
  • •
    L2 Query Understanding: NER slot parsing builds strict metadata pre-filters
  • •
    L2 Hybrid Search: RRF blends exact BM25 lexical hits with semantic vector neighbors
  • •
    L3 Relevance Gate: enforce cross-encoder relevance >= threshold before multiplying GMV/CVR

📐 Mathematical Derivations

Cache pre-ranked head-query lists in Redis with live in-stock bitmask checks to cut GPU cross-encoder volume by ~70%.

🏭 Production Trade-offs

Apply stock and category predicates during HNSW graph traversal (pre-filtering) so rare SKUs never return empty pages.
⚠️ Common Interview Pitfalls
  • ✕
    Post-filtering dense ANN Top-K leaves nearly zero valid in-stock hits
  • ✕
    Unconstrained CTR maximization rewards misleading clickbait titles with high return rates
🎯 Interviewer Follow-up Inquiries
  • ?
    How do you train multilingual query-to-catalog embeddings cleanly?
  • ?
    What gradual query relaxation ladder recovers zero-result exact searches?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
🎯 Drill This Card Now➔
📚

Associated Knowledge Base Guides & Mindmaps

← PreviousM9-003: Design a Cold-Start Item & Creator Exploration Pipeline📋 Back to BankNext →M9-005: Design a Notification Timing, Volume & Unsubscribe-Guard System