🔬 Applied Scientist & ML Specialist938 Problems · 127 Topics🌐 Linked to Tech Vault

TalentMe Science Depth: Universal Applied Science & ML Depth Problem Bank

938 end-to-end science depth, system design, transition bridge & BQ problems covering derivations, production trade-offs, pitfalls, and follow-ups.

🎯

Science Depth Mastery Tracker

0% Mastered

Locally synced in your browser. Track, review, and master all 938 scientific & design topics.

Mastered: 0
Reviewing: 0
Unstarted: 119
🚀 Start Next Unpracticed →
🌐
Linked to TalentMe Tech Vault & MindmapsM2: Classical Machine Learning
All 938 questions are directly linked to TalentMe's Tech Vault guides, atomic cards, and interactive mindmaps.
🧭Classical ML Mindmap & Cards→📖Decision Trees, GBDT & XGBoost→🎯MLE Cheatsheet→
Found 24 in-depth questions
M2-073Classical Machine LearningClass Imbalance Learning
Medium

Why Prioritize PR-AUC Over ROC-AUC in Highly Imbalanced Regimes?

⚡ One-Sentence Answer

ROC-AUC uses False Positive Rate, which is diluted by a massive negative class; PR-AUC uses Precision, which directly penalizes false positives against the rare positive class.

Math & Tradeoffs→
M2-074Classical Machine LearningClass Imbalance Learning
Medium

Classification Threshold Selection Strategies Across Diverse Business Objectives

⚡ One-Sentence Answer

Select thresholds by minimizing expected cost via cost matrices or meeting business constraints (e.g., recall floor) using a calibrated validation set.

Math & Tradeoffs→
M2-075Classical Machine LearningClass Imbalance Learning
Hard

Cost-Sensitive Learning: Implementation and Relationship with Re-sampling

⚡ One-Sentence Answer

Incorporate class weights into the loss function; it is asymptotically equivalent to re-sampling but avoids data duplication and stabilizes empirical training variance.

Math & Tradeoffs→
M2-076Classical Machine LearningMissing Values & Data Leakage
Easy

Three Missing Data Mechanisms (MCAR, MAR, MNAR) and Treatment Strategies

⚡ One-Sentence Answer

Rubin's taxonomy defines MCAR (completely random), MAR (conditional on observed data), and MNAR (dependent on unobserved missing values); treatments range from simple imputation to pattern modeling.

Math & Tradeoffs→
M2-077Classical Machine LearningMissing Values & Data Leakage
Medium

Comparing Mean/Median, KNN, and Multiple Imputation (MICE)

⚡ One-Sentence Answer

Mean/median is fast but underestimates variance; KNN captures local correlations at high inference cost; MICE preserves uncertainty and distribution fidelity through chained equations.

Math & Tradeoffs→
M2-078Classical Machine LearningMissing Values & Data Leakage
Medium

When Should You Add a 'Missing Indicator Variable'?

⚡ One-Sentence Answer

Add a binary missing indicator whenever missingness conveys predictive intent (MNAR/informative missingness) or when pairing with mean/median imputation.

Math & Tradeoffs→
M2-079Classical Machine LearningMissing Values & Data Leakage
Hard

How to Systematically Audit Data Leakage? An Actionable Checklist

⚡ One-Sentence Answer

Audit temporal splits, preprocessing pipelines, target proxies, duplicate entities, and ID features to prevent future or test information from leaking into training.

Math & Tradeoffs→
M2-080Classical Machine LearningMissing Values & Data Leakage
Hard

Why Global Normalization Before Splitting Causes Data Leakage and How to Fix It

⚡ One-Sentence Answer

Global standardization uses test set mean and variance to scale training data, artificially shrinking generalization error; fix by fitting scalers strictly on training folds.

Math & Tradeoffs→
M2-081Classical Machine LearningModel Calibration
Easy

Defining Model Calibration: Why High Accuracy Does Not Imply Good Calibration

⚡ One-Sentence Answer

A model is calibrated when its predicted probability matches empirical ground truth frequency; a highly accurate model can still be severely overconfident.

Math & Tradeoffs→
M2-082Classical Machine LearningModel Calibration
Medium

Comparing Platt Scaling and Isotonic Regression for Probability Calibration

⚡ One-Sentence Answer

Platt scaling fits a parametric sigmoid to model logits; Isotonic regression fits a non-parametric piecewise-constant isotonic step function.

Math & Tradeoffs→
M2-083Classical Machine LearningModel Calibration
Medium

Expected Calibration Error (ECE): Mathematical Formulation and Practical Limitations

⚡ One-Sentence Answer

ECE partitions predictions into probability bins and computes the weighted average gap between confidence and accuracy; limitations include sensitivity to bin count and edge bias.

Math & Tradeoffs→
M2-084Classical Machine LearningModel Calibration
Medium

Temperature Scaling for Calibrating Deep Neural Networks

⚡ One-Sentence Answer

A single scalar parameter $T > 0$ divides pre-softmax logits, softening or sharpening probabilities without changing the argmax prediction order or classification accuracy.

Math & Tradeoffs→
M2-085Classical Machine LearningModel Calibration
Hard

Scenarios Where Calibration is Critical: Core Use Cases and Concrete Examples

⚡ One-Sentence Answer

Calibration is vital whenever decisions depend on expected value calculations, safety cost thresholds, or multi-model probability fusion.

Math & Tradeoffs→
M2-086Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Easy

Common Evaluation Metrics for Classification, Regression, and Ranking

⚡ One-Sentence Answer

Classification uses Accuracy, F1, PR-AUC, and ROC-AUC; regression uses RMSE, MAE, and MAPE; ranking uses NDCG, MRR, and MAP.

Math & Tradeoffs→
M2-087Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Medium

Comparing Grid Search, Random Search, and Bayesian Optimization

⚡ One-Sentence Answer

Grid search suffers from exponential dimensional explosion; Random search explores continuous spaces efficiently; Bayesian optimization constructs probabilistic surrogates to balance exploration and exploitation.

Math & Tradeoffs→
M2-088Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Medium

Hyperparameter Importance Hierarchy and Efficient Tuning Strategies

⚡ One-Sentence Answer

Prioritize learning rate and regularization first, architecture second, and secondary parameters last; employ coarse-to-fine search and early-pruning strategies.

Math & Tradeoffs→
M2-089Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Hard

Handling Randomness and Seed Variance in Hyperparameter Tuning

⚡ One-Sentence Answer

Evaluate configurations across multiple random seeds, report mean and confidence intervals, and apply paired statistical tests to distinguish genuine improvements from seed noise.

Math & Tradeoffs→
M2-090Classical Machine LearningEvaluation Metrics & Hyperparameter Tuning
Hard

Why Offline and Online Evaluations Diverge: Causes and Mitigation Strategies

⚡ One-Sentence Answer

Divergence stems from distribution drift, proxy metric misalignment, feedback loops, and latency; mitigate via off-policy evaluation, correlation tracking, and canary A/B tests.

Math & Tradeoffs→
M2-091Classical Machine LearningFeature Selection
Hard

Evaluating Feature Importance in Neural Networks vs Tree Models

⚡ One-Sentence Answer

Neural networks utilize gradient-based attribution (Integrated Gradients, Saliency) and perturbation methods, whereas tree models rely on impurity gain, split count, and TreeSHAP.

Math & Tradeoffs→
M2-092Classical Machine LearningLinear Regression
Medium

Weighted Least Squares (WLS) and Handling Heteroscedasticity

⚡ One-Sentence Answer

WLS weights each residual inversely by the error variance ($w_i = 1/\sigma_i^2$), transforming heteroscedastic data into homoscedastic space to restore BLUE optimality.

Math & Tradeoffs→
M2-093Classical Machine LearningLinear Regression
Medium

Interaction and Polynomial Terms in Regression: Formulations and Regularization

⚡ One-Sentence Answer

Incorporate non-linear effects and conditional dynamics via product terms; mitigate overfitting using the hierarchical principle, centering, and L1/L2 regularization.

Math & Tradeoffs→
M2-094Classical Machine LearningLogistic Regression & GLM
Medium

Multinomial Logistic Regression (Softmax Regression) and Parameter Identifiability

⚡ One-Sentence Answer

Softmax regression generalizes logistic regression to $K$ classes; overparameterization requires fixing one class vector to zero (reference class) to ensure parameter identifiability.

Math & Tradeoffs→
M2-095Classical Machine LearningLogistic Regression & GLM
Hard

Relationship Between Logistic Regression and the Maximum Entropy Model

⚡ One-Sentence Answer

They are mathematically dual: maximizing likelihood in logistic regression is equivalent to maximizing conditional entropy subject to empirical moment constraints.

Math & Tradeoffs→
M2-096Classical Machine LearningRegularization (L1 / L2)
Medium

Bayesian Interpretation of L1 and L2 Regularization

⚡ One-Sentence Answer

L2 regularization corresponds to a Gaussian prior (shrinkage); L1 regularization corresponds to an independent Laplace prior (sparsity via its non-differentiable peak at zero).

Math & Tradeoffs→