M1-082M1: Mathematics & Statistics FundamentalsConfidence Intervals & BootstrapHard
⚡Flashcard Drill➔Mastery:

Explain Block Bootstrap and Its Vital Role in Preserving Dependent Time Series Autocorrelation

🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
Next: M1-083 →
📐 Mathematical Definition
block bootstrap: resample blocks of length L\text{block bootstrap}:\ \text{resample blocks of length } L
⚡ One-Sentence Core Answer
Standard bootstrap breaks down on time series because i.i.d. point resampling destroys temporal autocorrelation; Block Bootstrap resamples consecutive blocks of length LL, preserving local temporal dependence structures.

📌 Key Takeaways

  • •
    Failure of standard bootstrap: Shuffling individual time points destroys lag correlations Cov(Xt,Xt−k)\text{Cov}(X_t, X_{t-k}), producing severely underestimated standard errors.
  • •
    Moving Block Bootstrap (MBB): Resamples overlapping blocks of length LL with replacement to reconstruct a pseudo-series of length NN.
  • •
    Stationary Bootstrap (Politis & Romano): Uses random block lengths drawn from a Geometric distribution with mean LL, guaranteeing that the bootstrapped series remains strictly stationary.

📐 Mathematical Derivations

Mechanics of Moving Block Bootstrap (MBB): Given time series X1,…,XNX_1, \dots, X_N with block length LL. Define N−L+1N - L + 1 overlapping blocks Bi={Xi,Xi+1,…,Xi+L−1}B_i = \{X_i, X_{i+1}, \dots, X_{i+L-1}\}. To construct a bootstrap series of length NN, draw K=⌈N/L⌉K = \lceil N/L \rceil blocks uniformly at random with replacement from {B1,…,BN−L+1}\{B_1, \dots, B_{N-L+1}\} and concatenate them. The intra-block autocorrelation structure for lags k<Lk < L is preserved exactly as in the empirical data. Hall et al. (1995) proved that optimal block length balances variance and bias: for estimating variance of the sample mean under strong mixing, optimal block length scales as L∝N1/3L \propto N^{1/3}.

🏭 Production Trade-offs

Applications in ML forecasting and macro metrics: (1) Constructing realistic prediction intervals for transformer time series forecasts (PatchTST, TimesNet). (2) In switchback experiments with hourly or daily auto-correlated demand, block bootstrap clusters adjacent time intervals together to avoid optimistic p-values.
⚠️ Common Interview Pitfalls
  • ✕
    Choosing block length LL too small (L=1L=1 degenerates to naive i.i.d. bootstrap, destroying all dependency).
  • ✕
    Choosing block length LL too large (drastically reduces the number of distinct blocks, inflating variance).
🎯 Interviewer Follow-up Inquiries
  • ?
    How does the Stationary Bootstrap ensure mathematical stationarity through geometrically distributed block lengths?
  • ?
    How does block bootstrap account for seasonal cycles (e.g. 7-day weekly seasonality)?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
🎯 Drill This Card Now➔
📚

Associated Knowledge Base Guides & Mindmaps

← PreviousM1-081: Explain the Delta Method and Its Mathematical Conditions for Ratio Metric Asymptotic Variance📋 Back to BankNext →M1-083: Explain Stratified Randomization in Experimental Design and When It Is Strictly Required