🔬 Applied Scientist & ML Specialist938 Problems · 127 Topics🌐 Linked to Tech Vault

TalentMe Science Depth: Universal Applied Science & ML Depth Problem Bank

938 end-to-end science depth, system design, transition bridge & BQ problems covering derivations, production trade-offs, pitfalls, and follow-ups.

🎯

Science Depth Mastery Tracker

0% Mastered

Locally synced in your browser. Track, review, and master all 938 scientific & design topics.

Mastered: 0
Reviewing: 0
Unstarted: 938
🚀 Start Next Unpracticed →
🌐
Linked to TalentMe Tech Vault & MindmapsGlobal System
All 938 questions are directly linked to TalentMe's Tech Vault guides, atomic cards, and interactive mindmaps.
🧭Math Foundations Mindmap & Cards→📖Bayesian Inference, Entropy & KL Divergence→🎯DS Track→
Found 24 in-depth questions
M5-060NLP & Large Language ModelsGRPO & Reasoning Models
Hard

Group Size and Sampling Efficiency in GRPO

⚡ One-Sentence Answer

GRPO group size $G$ balances statistical advantage estimation accuracy against rollout generation compute, with $G \in [8, 16]$ providing the optimal trade-off for variance reduction and GPU scheduling efficiency.

Math & Tradeoffs→
M5-061NLP & Large Language ModelsGRPO & Reasoning Models
Hard

Cold Start Problem in Zero-RL / RLVR and Mitigation Strategies

⚡ One-Sentence Answer

The cold start problem occurs when a base model has a near-zero success rate on hard reasoning tasks, producing zero positive rewards and stalling RLVR exploration, solved through curated CoT seed demonstrations, prompt scaffolding, and difficulty curricula.

Math & Tradeoffs→
M5-062NLP & Large Language ModelsGRPO & Reasoning Models
Hard

Length Control and Length Penalties in Long CoT Reasoning

⚡ One-Sentence Answer

Long CoT models naturally drift toward extreme verbosity and repetitive looping during RL, requiring length penalties, repetition filters, and format constraints to ensure reasoning tokens reflect genuine cognitive work.

Math & Tradeoffs→
M5-063NLP & Large Language ModelsGRPO & Reasoning Models
Hard

Reasoning Model Distillation: Transferring Long CoT into Compact Models

⚡ One-Sentence Answer

Distilling reasoning capabilities by fine-tuning compact models on curated reasoning traces from frontier models is vastly more compute-efficient than training small models via RL from scratch, though bounded by the teacher's capability ceiling.

Math & Tradeoffs→
M5-064NLP & Large Language ModelsGRPO & Reasoning Models
Hard

Process Reward Models (PRM) vs. Outcome Reward Models (ORM): Usage and Annotation Cost

⚡ One-Sentence Answer

Outcome Reward Models (ORM) evaluate only final answer correctness with minimal annotation expense, whereas Process Reward Models (PRM) score every intermediate step to provide fine-grained credit assignment at the cost of massive human labeling overhead.

Math & Tradeoffs→
M5-065NLP & Large Language ModelsGRPO & Reasoning Models
Hard

Efficiency Challenges in Reasoning Models: Overthinking and Length Adaptation

⚡ One-Sentence Answer

Reasoning models frequently suffer from overthinking—spending thousands of reasoning tokens on trivial queries—requiring difficulty-adaptive budget allocation and early-exit mechanisms to control operational costs and prevent reasoning degradation.

Math & Tradeoffs→
M5-066NLP & Large Language ModelsPrompting & Reasoning Techniques
Easy

Why Chain-of-Thought (CoT) Works: A Computational Perspective

⚡ One-Sentence Answer

Chain-of-Thought works because it transforms serial computational depth from fixed network layers into autoregressive sequence length, providing dynamic external working memory that breaks the constant-depth expressivity limits of Transformers.

Math & Tradeoffs→
M5-067NLP & Large Language ModelsPrompting & Reasoning Techniques
Easy

Self-Consistency and Majority Voting in LLM Reasoning

⚡ One-Sentence Answer

Self-Consistency samples multiple diverse Chain-of-Thought reasoning paths at elevated temperatures and selects the final answer via majority voting, exploiting the principle that valid reasoning paths converge on identical answers while error paths disperse randomly.

Math & Tradeoffs→
M5-068NLP & Large Language ModelsPrompting & Reasoning Techniques
Medium

Tree-of-Thought (ToT) vs. ReAct: Internal Deliberation vs. External Interaction

⚡ One-Sentence Answer

Tree-of-Thought conducts deliberate internal tree search with backtracking and state evaluation without external tools, whereas ReAct interleaves internal reasoning with external tool actions and environmental observations.

Math & Tradeoffs→
M5-069NLP & Large Language ModelsPrompting & Reasoning Techniques
Medium

Few-Shot Example Selection and Ordering Effects in In-Context Learning

⚡ One-Sentence Answer

The performance of few-shot in-context learning is highly sensitive to example selection and order, with permutation changes causing up to 30% accuracy swings due to recency bias and majority class imbalance.

Math & Tradeoffs→
M5-070NLP & Large Language ModelsPrompting & Reasoning Techniques
Hard

Prompt Brittleness and Robustness in Large Language Models

⚡ One-Sentence Answer

Prompt brittleness describes sharp performance drops caused by trivial textual perturbations such as whitespace changes or synonym swaps, mitigated through prompt calibration, multi-prompt ensembling, and instruction fine-tuning.

Math & Tradeoffs→
M5-071NLP & Large Language ModelsPrompting & Reasoning Techniques
Hard

Self-Reflection and Self-Critique Mechanisms and Limitations in LLMs

⚡ One-Sentence Answer

Self-reflection improves multi-turn task success by prompting models to critique and refine past actions, but fundamentally fails when models attempt to verify factual claims without external ground-truth feedback.

Math & Tradeoffs→
M5-072NLP & Large Language ModelsPrompting & Reasoning Techniques
Medium

Prompt Formatting Sensitivity and the Impact of Chat Templates

⚡ One-Sentence Answer

Chat templates standardize the serialization of multi-turn dialogues into unambiguous token streams, preventing prompt injection and formatting mismatch that otherwise degrade model comprehension.

Math & Tradeoffs→
M5-073NLP & Large Language ModelsRAG End-to-End Architecture
Easy

Architecture and Components of a Complete RAG System

⚡ One-Sentence Answer

A production RAG system orchestrates document ingestion, chunking, dense-sparse hybrid retrieval, cross-encoder reranking, and context-augmented generation to provide accurate, grounded responses from external knowledge bases.

Math & Tradeoffs→
M5-074NLP & Large Language ModelsRAG End-to-End Architecture
Easy

Document Chunking Strategies and Trade-offs in RAG

⚡ One-Sentence Answer

Chunking balances semantic self-containment against vector embedding specificity, utilizing fixed-size overlapping windows, recursive structural splitting, semantic breakpoint detection, or hierarchical parent-child indexing.

Math & Tradeoffs→
M5-075NLP & Large Language ModelsRAG End-to-End Architecture
Medium

Hybrid Search and Reciprocal Rank Fusion (BM25 + Dense + RRF)

⚡ One-Sentence Answer

Hybrid search combines sparse BM25 keyword matching and dense vector semantic retrieval, utilizing Reciprocal Rank Fusion (RRF) to merge non-comparable score distributions into a robust ranking without manual score calibration.

Math & Tradeoffs→
M5-076NLP & Large Language ModelsRAG End-to-End Architecture
Medium

Cross-Encoder Reranking: Value, Trade-offs, and Compute Cost

⚡ One-Sentence Answer

Cross-encoders evaluate deep all-to-all cross-attention between query and document tokens to eliminate bi-encoder information loss, filtering retrieved candidates down to top-relevance chunks at the cost of higher latency.

Math & Tradeoffs→
M5-077NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Evaluation Dimensions and Frameworks for RAG Systems

⚡ One-Sentence Answer

RAG evaluation is structured around the RAG Triad—Faithfulness (groundedness in retrieved context), Answer Relevance (satisfaction of the user query), and Context Relevance (precision of retrieved chunks)—evaluated via frameworks like Ragas and TruLens.

Math & Tradeoffs→
M5-078NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Self-RAG and Adaptive Retrieval Mechanisms

⚡ One-Sentence Answer

Self-RAG trains language models to adaptively decide when to retrieve documents and evaluate retrieved evidence dynamically using special reflection tokens, eliminating redundant retrieval and improving groundedness.

Math & Tradeoffs→
M5-079NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Vector Indexing and Search Efficiency: HNSW vs. IVF-PQ

⚡ One-Sentence Answer

Approximate Nearest Neighbor (ANN) search trades exact recall for sub-linear latency, with HNSW providing maximum recall and ultra-fast graph traversal at high RAM expense, and IVF-PQ compressing vectors into inverted lists to maximize memory scalability.

Math & Tradeoffs→
M5-080NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Embedding Model Selection, Dimensions, and Domain Fine-Tuning

⚡ One-Sentence Answer

Dense embedding models are selected via MTEB benchmarks and domain requirements, optimized via Matryoshka Representation Learning for flexible dimensionality, and fine-tuned on domain data using contrastive learning with mined hard negatives.

Math & Tradeoffs→
M5-081NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Query Transformation Techniques: HyDE, Multi-Query, and Step-Back Prompting

⚡ One-Sentence Answer

Query transformation bridges the vocabulary and semantic gap between short colloquial user queries and detailed technical documents using hypothetical document generation, multi-query expansion, and abstract step-back reasoning.

Math & Tradeoffs→
M5-082NLP & Large Language ModelsRAG End-to-End Architecture
Hard

GraphRAG and Structured Knowledge Retrieval

⚡ One-Sentence Answer

GraphRAG extracts knowledge graphs of entities and relationships from unstructured corpora, constructing hierarchical community summaries that enable global sensemaking queries that traditional vector RAG cannot answer.

Math & Tradeoffs→
M5-083NLP & Large Language ModelsRAG End-to-End Architecture
Medium

Long Context Windows vs. RAG: Comparative Trade-offs

⚡ One-Sentence Answer

Long context windows preserve global semantic coherence and eliminate retrieval failure for contained documents at quadratic attention cost, whereas RAG provides cost-effective, scalable, and dynamic knowledge access over massive corpora.

Math & Tradeoffs→