M1-084M1: Mathematics & Statistics Fundamentals实验设计 (A/B)Hard
⚡Flashcard Drill➔Mastery:

Explain Switchback Experiments and Their Applications in Marketplace and Two-Sided Delivery Platforms

🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
Next: M1-085 →
📐 Mathematical Definition
switchback:alternate treatments over time windows\text{switchback}: \text{alternate treatments over time windows}
⚡ One-Sentence Core Answer
A switchback experiment alternates treatment and control policies sequentially over time intervals across geographical regions, overcoming two-sided marketplace interference where users and drivers share a single supply pool.

📌 Key Takeaways

  • •
    Core Motivation: In ride-sharing (Uber, Lyft, DoorDash), treating passenger A cannibalizes driver supply for passenger B (violating SUTVA).
  • •
    Design Structure: Divides physical space into clusters (cities/zones) and time into windows (e.g. 30-minute intervals); each window randomly switches between Treatment and Control.
  • •
    Washout Periods: Discards data from the first 5-10 minutes of each window to allow supply-demand system dynamics to reset.

📐 Mathematical Derivations

Unit of randomization is the Cluster-Time Window (r,t)(r, t) rather than individual user ii. The regression model is: Yrt=β0+τTrt+γr+δt+ϵrtY_{rt} = \beta_0 + \tau T_{rt} + \gamma_r + \delta_t + \epsilon_{rt}, where γr\gamma_r is region fixed effect and δt\delta_t is time-of-day/day-of-week fixed effect. Standard errors must be clustered at the Cluster-Time level (or Region level via Block Bootstrap) to account for strong temporal autocorrelation across adjacent time intervals: Cov(ϵr,t,ϵr,t−1)>0\text{Cov}(\epsilon_{r, t}, \epsilon_{r, t-1}) > 0. Naive user-level standard error calculation results in false positive rates exceeding 50% due to unmodeled intra-window clustering.

🏭 Production Trade-offs

Switchback design trade-offs: (1) Window length: Short windows (15 min) increase effective sample count but suffer from severe carryover bias (drivers dispatched under Treatment algorithm carry over into Control window). Long windows (2 hours) eliminate carryover but reduce sample size and power. (2) Washout periods: Discarding the initial 10 minutes of each window cleans carryover effects at the expense of lost data throughput.
⚠️ Common Interview Pitfalls
  • ✕
    Evaluating user-level p-values directly in a switchback experiment (massive Type I error inflation; must aggregate to the window level).
  • ✕
    Ignoring carryover effects from past windows without incorporating washout buffers.
🎯 Interviewer Follow-up Inquiries
  • ?
    How does carryover bias distort treatment effect estimation in switchback designs?
  • ?
    Why must standard errors in switchback experiments be clustered at the geographic region level?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
🎯 Drill This Card Now➔
📚

Associated Knowledge Base Guides & Mindmaps

← PreviousM1-083: Explain Stratified Randomization in Experimental Design and When It Is Strictly Required📋 Back to BankNext →M1-085: Explain Why Individual Randomization Fails Under Network Spillover/Interference and How Cluster Randomization Solves It