🔬 Applied Scientist & ML Specialist938 Problems · 127 Topics🌐 Linked to Tech Vault

TalentMe Science Depth: Universal Applied Science & ML Depth Problem Bank

938 end-to-end science depth, system design, transition bridge & BQ problems covering derivations, production trade-offs, pitfalls, and follow-ups.

🎯

Science Depth Mastery Tracker

0% Mastered

Locally synced in your browser. Track, review, and master all 938 scientific & design topics.

Mastered: 0
Reviewing: 0
Unstarted: 119
🚀 Start Next Unpracticed →
🌐
Linked to TalentMe Tech Vault & MindmapsM2: Classical Machine Learning
All 938 questions are directly linked to TalentMe's Tech Vault guides, atomic cards, and interactive mindmaps.
🧭Classical ML Mindmap & Cards→📖Decision Trees, GBDT & XGBoost→🎯MLE Cheatsheet→
Found 23 in-depth questions
M2-097Classical Machine LearningRegularization (L1 / L2)
Hard

Why Weight Decay Must Be Decoupled in Adam (AdamW)

⚡ One-Sentence Answer

L2 regularization couples weight decay with gradient second moments, diluting regularization for large-gradient weights; AdamW restores true weight decay by decoupling it from gradient scaling.

Math & Tradeoffs→
M2-098Classical Machine LearningRegularization (L1 / L2)
Hard

Spectral Norm Regularization and Lipschitz Continuity Constraints

⚡ One-Sentence Answer

Bounding the spectral norm (maximum singular value) of each layer's weight matrix bounds the network's global Lipschitz constant, stabilizing GAN training and ensuring robustness.

Math & Tradeoffs→
M2-099Classical Machine LearningRegularization (L1 / L2)
Hard

Stochastic Depth (DropPath) vs Standard Dropout: Mechanisms and Differences

⚡ One-Sentence Answer

Dropout randomly zeroes out individual activations, whereas Stochastic Depth drops entire residual blocks during training, shortening effective depth and perfectly preserving BatchNorm statistics.

Math & Tradeoffs→
M2-100Classical Machine LearningBias-Variance Tradeoff & Model Selection
Medium

AIC, BIC, and Adjusted R-squared: Penalized Metrics vs Cross-Validation

⚡ One-Sentence Answer

AIC and BIC penalize model complexity analytically based on likelihood; AIC asymptotically equates to Leave-One-Out CV, while BIC enforces selection consistency.

Math & Tradeoffs→
M2-101Classical Machine LearningBias-Variance Tradeoff & Model Selection
Medium

Learning Curves vs Validation Curves: Formulations and Diagnostic Workflows

⚡ One-Sentence Answer

Learning curves plot error against training set size to diagnose data sufficiency; validation curves plot error against a hyperparameter to diagnose bias-variance trade-offs.

Math & Tradeoffs→
M2-102Classical Machine LearningBias-Variance Tradeoff & Model Selection
Medium

How Model Ensembling Impacts Bias and Variance

⚡ One-Sentence Answer

Bagging reduces variance through parallel averaging; Boosting reduces bias through sequential residual fitting; Stacking optimizes combinations of diverse base hypotheses.

Math & Tradeoffs→
M2-103Classical Machine LearningBias-Variance Tradeoff & Model Selection
Medium

When Does Adding More Data Fail to Improve Model Performance?

⚡ One-Sentence Answer

Adding data fails when performance is bottlenecked by high model bias, irreducible Bayes noise, distribution shift, or systematic label corruption.

Math & Tradeoffs→
M2-104Classical Machine LearningBias-Variance Tradeoff & Model Selection
Hard

The 'No Free Lunch' Theorem and Inductive Bias Explained

⚡ One-Sentence Answer

No learning algorithm is universally superior across all possible problems; superior performance on a specific task arises solely from matching the algorithm's inductive bias to the data structure.

Math & Tradeoffs→
M2-105Classical Machine Learning集成方法 (Bagging/RF)
Medium

The AdaBoost Algorithm and Its Exponential Loss Function

⚡ One-Sentence Answer

AdaBoost trains weak classifiers sequentially by reweighting misclassified samples, which corresponds to stage-wise additive modeling minimizing exponential loss.

Math & Tradeoffs→
M2-106Classical Machine Learning集成方法 (Bagging/RF)
Hard

Comparing Model Ensembling Strategies: Simple Average, Weighted Average, and Stacking

⚡ One-Sentence Answer

Simple average reduces variance without tuning; weighted average optimizes linear coefficients on validation data; Stacking fits a meta-learner on out-of-fold predictions.

Math & Tradeoffs→
M2-107Classical Machine Learning梯度提升 (GBDT/XGBoost)
Medium

How GBDT Supports Custom Loss Functions via First and Second Order Gradients

⚡ One-Sentence Answer

GBDT utilizes second-order Taylor expansion to approximate custom loss functions, deriving optimal leaf values and split gains using only sample gradients and Hessians.

Math & Tradeoffs→
M2-108Classical Machine Learning梯度提升 (GBDT/XGBoost)
Hard

Monotonicity Constraints in GBDT and Their Industrial Business Value

⚡ One-Sentence Answer

Monotonicity constraints enforce that predictions must monotonically increase or decrease with specific features, preventing counter-intuitive decisions and ensuring regulatory compliance.

Math & Tradeoffs→
M2-109Classical Machine Learning梯度提升 (GBDT/XGBoost)
Medium

Methods for Handling Class Imbalance in GBDT and Their Trade-offs

⚡ One-Sentence Answer

GBDT handles imbalance via positive class loss reweighting (scale_pos_weight), bagging undersampling, or custom focal loss; each affects calibration and split gains differently.

Math & Tradeoffs→
M2-110Classical Machine Learning梯度提升 (GBDT/XGBoost)
Medium

Early Stopping in GBDT and Determining the Optimal Number of Iterations

⚡ One-Sentence Answer

Monitor validation loss after each boosting round and stop training when error fails to improve for $P$ consecutive rounds, coupling optimal trees with learning rate.

Math & Tradeoffs→
M2-111Classical Machine Learning梯度提升 (GBDT/XGBoost)
Hard

Differences Between GBDT Built-in Feature Importance and TreeSHAP Values

⚡ One-Sentence Answer

Built-in GBDT importance (split/gain) suffers from inconsistency and bias toward high cardinality; TreeSHAP provides consistent, additive attribution with local explanations.

Math & Tradeoffs→
M2-112Classical Machine LearningFeature Engineering
Medium

Target Encoding Implementation Details: Out-of-Fold Cross-Fitting and Smoothing

⚡ One-Sentence Answer

Target encoding maps categories to expected target values; prevent severe overfitting using Empirical Bayes smoothing and strict out-of-fold cross-fitting.

Math & Tradeoffs→
M2-113Classical Machine LearningFeature Engineering
Hard

Text Features: Comparing TF-IDF and Dense Embedding Representations

⚡ One-Sentence Answer

TF-IDF builds sparse lexical frequency vectors suitable for exact keyword matching; dense embeddings capture deep semantic context and synonymy.

Math & Tradeoffs→
M2-114Classical Machine LearningClass Imbalance Learning
Medium

Imbalanced Ensembling: EasyEnsemble and BalanceCascade Explained

⚡ One-Sentence Answer

EasyEnsemble trains independent learners on multiple balanced bootstrap subsets; BalanceCascade sequentially eliminates correctly classified majority samples.

Math & Tradeoffs→
M2-115Classical Machine LearningClass Imbalance Learning
Hard

Post-Deployment Monitoring and Evaluation Under Severe Class Imbalance

⚡ One-Sentence Answer

Monitor positive prior drift, segmented precision/recall, calibration quality, and business metrics; severe imbalance makes global aggregated metrics deceptive.

Math & Tradeoffs→
M2-116Classical Machine LearningMissing Values & Data Leakage
Hard

MICE (Multiple Imputation by Chained Equations): Iterative Process and Key Details

⚡ One-Sentence Answer

MICE imputes missing values iteratively by specifying univariate conditional regression models per feature, pooling $M$ generated datasets via Rubin's rules.

Math & Tradeoffs→
M2-117Classical Machine LearningMissing Values & Data Leakage
Hard

Preventing Data Leakage in Time Series and Panel Data: Critical Safeguards

⚡ One-Sentence Answer

Enforce strict temporal splits, right-open rolling windows, entity-grouped feature pipelines, and expanding-window statistics to eliminate future leakage.

Math & Tradeoffs→
M2-118Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Medium

Multi-Metric Trade-offs and Designing an Overall Evaluation Criterion (OEC)

⚡ One-Sentence Answer

An OEC synthesizes competing metrics into a unified objective to streamline decision-making, bounded by non-negotiable guardrail metrics.

Math & Tradeoffs→
M2-119Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Hard

Automated Hyperparameter Optimization Tools and Industrial Best-Practice Workflows

⚡ One-Sentence Answer

Tools like Optuna and Ray Tune implement TPE, Hyperband, and ASHA to optimize hyperparameters through coarse screening, fine tuning, and early trial pruning.

Math & Tradeoffs→