M1-082M1: Mathematics & Statistics FundamentalsConfidence Intervals & BootstrapHard
⚡Flashcard Drill➔Mastery:
Explain Block Bootstrap and Its Vital Role in Preserving Dependent Time Series Autocorrelation
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Standard bootstrap breaks down on time series because i.i.d. point resampling destroys temporal autocorrelation; Block Bootstrap resamples consecutive blocks of length , preserving local temporal dependence structures.
📌 Key Takeaways
- •Failure of standard bootstrap: Shuffling individual time points destroys lag correlations , producing severely underestimated standard errors.
- •Moving Block Bootstrap (MBB): Resamples overlapping blocks of length with replacement to reconstruct a pseudo-series of length .
- •Stationary Bootstrap (Politis & Romano): Uses random block lengths drawn from a Geometric distribution with mean , guaranteeing that the bootstrapped series remains strictly stationary.
📐 Mathematical Derivations
Mechanics of Moving Block Bootstrap (MBB): Given time series with block length . Define overlapping blocks . To construct a bootstrap series of length , draw blocks uniformly at random with replacement from and concatenate them. The intra-block autocorrelation structure for lags is preserved exactly as in the empirical data. Hall et al. (1995) proved that optimal block length balances variance and bias: for estimating variance of the sample mean under strong mixing, optimal block length scales as .
🏭 Production Trade-offs
Applications in ML forecasting and macro metrics: (1) Constructing realistic prediction intervals for transformer time series forecasts (PatchTST, TimesNet). (2) In switchback experiments with hourly or daily auto-correlated demand, block bootstrap clusters adjacent time intervals together to avoid optimistic p-values.
⚠️ Common Interview Pitfalls
- ✕Choosing block length too small ( degenerates to naive i.i.d. bootstrap, destroying all dependency).
- ✕Choosing block length too large (drastically reduces the number of distinct blocks, inflating variance).
🎯 Interviewer Follow-up Inquiries
- ?How does the Stationary Bootstrap ensure mathematical stationarity through geometrically distributed block lengths?
- ?How does block bootstrap account for seasonal cycles (e.g. 7-day weekly seasonality)?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚