🔬 Applied Scientist & ML Specialist938 Problems · 127 Topics🌐 Linked to Tech Vault

TalentMe Science Depth: Universal Applied Science & ML Depth Problem Bank

938 end-to-end science depth, system design, transition bridge & BQ problems covering derivations, production trade-offs, pitfalls, and follow-ups.

🎯

Science Depth Mastery Tracker

0% Mastered

Locally synced in your browser. Track, review, and master all 938 scientific & design topics.

Mastered: 0
Reviewing: 0
Unstarted: 136
🚀 Start Next Unpracticed →
🌐
Linked to TalentMe Tech Vault & MindmapsM5: NLP & Large Language Models
All 938 questions are directly linked to TalentMe's Tech Vault guides, atomic cards, and interactive mindmaps.
🧭LLM & Agent Pipelines Mindmap→📖RLHF, DPO & GRPO Reasoning→🎯AIE Fine-Tuning→
Found 24 in-depth questions
M5-073NLP & Large Language ModelsRAG End-to-End Architecture
Easy

Architecture and Components of a Complete RAG System

⚡ One-Sentence Answer

A production RAG system orchestrates document ingestion, chunking, dense-sparse hybrid retrieval, cross-encoder reranking, and context-augmented generation to provide accurate, grounded responses from external knowledge bases.

Math & Tradeoffs→
M5-074NLP & Large Language ModelsRAG End-to-End Architecture
Easy

Document Chunking Strategies and Trade-offs in RAG

⚡ One-Sentence Answer

Chunking balances semantic self-containment against vector embedding specificity, utilizing fixed-size overlapping windows, recursive structural splitting, semantic breakpoint detection, or hierarchical parent-child indexing.

Math & Tradeoffs→
M5-075NLP & Large Language ModelsRAG End-to-End Architecture
Medium

Hybrid Search and Reciprocal Rank Fusion (BM25 + Dense + RRF)

⚡ One-Sentence Answer

Hybrid search combines sparse BM25 keyword matching and dense vector semantic retrieval, utilizing Reciprocal Rank Fusion (RRF) to merge non-comparable score distributions into a robust ranking without manual score calibration.

Math & Tradeoffs→
M5-076NLP & Large Language ModelsRAG End-to-End Architecture
Medium

Cross-Encoder Reranking: Value, Trade-offs, and Compute Cost

⚡ One-Sentence Answer

Cross-encoders evaluate deep all-to-all cross-attention between query and document tokens to eliminate bi-encoder information loss, filtering retrieved candidates down to top-relevance chunks at the cost of higher latency.

Math & Tradeoffs→
M5-077NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Evaluation Dimensions and Frameworks for RAG Systems

⚡ One-Sentence Answer

RAG evaluation is structured around the RAG Triad—Faithfulness (groundedness in retrieved context), Answer Relevance (satisfaction of the user query), and Context Relevance (precision of retrieved chunks)—evaluated via frameworks like Ragas and TruLens.

Math & Tradeoffs→
M5-078NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Self-RAG and Adaptive Retrieval Mechanisms

⚡ One-Sentence Answer

Self-RAG trains language models to adaptively decide when to retrieve documents and evaluate retrieved evidence dynamically using special reflection tokens, eliminating redundant retrieval and improving groundedness.

Math & Tradeoffs→
M5-079NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Vector Indexing and Search Efficiency: HNSW vs. IVF-PQ

⚡ One-Sentence Answer

Approximate Nearest Neighbor (ANN) search trades exact recall for sub-linear latency, with HNSW providing maximum recall and ultra-fast graph traversal at high RAM expense, and IVF-PQ compressing vectors into inverted lists to maximize memory scalability.

Math & Tradeoffs→
M5-080NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Embedding Model Selection, Dimensions, and Domain Fine-Tuning

⚡ One-Sentence Answer

Dense embedding models are selected via MTEB benchmarks and domain requirements, optimized via Matryoshka Representation Learning for flexible dimensionality, and fine-tuned on domain data using contrastive learning with mined hard negatives.

Math & Tradeoffs→
M5-081NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Query Transformation Techniques: HyDE, Multi-Query, and Step-Back Prompting

⚡ One-Sentence Answer

Query transformation bridges the vocabulary and semantic gap between short colloquial user queries and detailed technical documents using hypothetical document generation, multi-query expansion, and abstract step-back reasoning.

Math & Tradeoffs→
M5-082NLP & Large Language ModelsRAG End-to-End Architecture
Hard

GraphRAG and Structured Knowledge Retrieval

⚡ One-Sentence Answer

GraphRAG extracts knowledge graphs of entities and relationships from unstructured corpora, constructing hierarchical community summaries that enable global sensemaking queries that traditional vector RAG cannot answer.

Math & Tradeoffs→
M5-083NLP & Large Language ModelsRAG End-to-End Architecture
Medium

Long Context Windows vs. RAG: Comparative Trade-offs

⚡ One-Sentence Answer

Long context windows preserve global semantic coherence and eliminate retrieval failure for contained documents at quadratic attention cost, whereas RAG provides cost-effective, scalable, and dynamic knowledge access over massive corpora.

Math & Tradeoffs→
M5-084NLP & Large Language ModelsRAG End-to-End Architecture
Hard

Common RAG Failure Modes and Systematic Debugging

⚡ One-Sentence Answer

RAG failures decompose into retrieval failures (missed chunks, low precision, out-of-domain embeddings), generation failures (hallucination, context ignoring, context conflict), and system integration bugs (metadata misalignment, stale indices).

Math & Tradeoffs→
M5-085NLP & Large Language ModelsAgents & Tool Use
Easy

ReAct Loop Architecture and Design Motivations

⚡ One-Sentence Answer

The ReAct paradigm tightly couples reasoning traces with external tool invocations in an alternating thought-action-observation cycle, overcoming LLM static parameter knowledge cutoffs and lack of environmental agency.

Math & Tradeoffs→
M5-086NLP & Large Language ModelsAgents & Tool Use
Easy

Implementation Essentials of Function Calling in LLMs

⚡ One-Sentence Answer

Function calling equips LLMs with JSON Schema definitions of external tools, prompting the model to emit deterministic structured argument payloads that the host executes and injects back as tool response messages.

Math & Tradeoffs→
M5-087NLP & Large Language ModelsAgents & Tool Use
Medium

Agent Memory Architecture: Short-Term, Long-Term, and Working Memory

⚡ One-Sentence Answer

Robust agent memory partitions state across three cognitive tiers: ephemeral short-term context window history, durable long-term external vector and graph stores across sessions, and volatile working memory tracking active task goal trees.

Math & Tradeoffs→
M5-088NLP & Large Language ModelsAgents & Tool Use
Medium

Multi-Agent Collaboration: Architectural Patterns and Operational Risks

⚡ One-Sentence Answer

Multi-agent systems partition complex objectives across specialized role-playing agents (planners, executors, critics), but introduce severe engineering risks including explosive communication token costs, cascading error propagation, and shared-model groupthink.

Math & Tradeoffs→
M5-089NLP & Large Language ModelsAgents & Tool Use
Hard

Evaluation Methodologies for Autonomous LLM Agents

⚡ One-Sentence Answer

Agent evaluation requires a multi-tiered framework combining end-to-end task completion rates in sandbox environments with step-level process metrics and cost-latency efficiency profiles.

Math & Tradeoffs→
M5-090NLP & Large Language ModelsAgents & Tool Use
Hard

Cost and Latency Control Strategies for Multi-Turn Agents

⚡ One-Sentence Answer

Because multi-turn agent execution compounds input tokens quadratically ($O(R^2)$) and incurs sequential multi-round network round-trips, production systems require aggressive context compression, tiered model routing, prompt caching, and strict budget gates.

Math & Tradeoffs→
M5-091NLP & Large Language ModelsAgents & Tool Use
Medium

Agent Planning and Hierarchical Task Decomposition

⚡ One-Sentence Answer

Planning equips agents with the ability to decompose complex objectives into structured, dependency-aware subtasks prior to execution, preventing the myopic drift and combinatorial trial-and-error common in purely greedy ReAct systems.

Math & Tradeoffs→
M5-092NLP & Large Language ModelsAgents & Tool Use
Hard

Agent Context Management and Window Compression Strategies

⚡ One-Sentence Answer

Because long-horizon workflows exhaust context limits, inflate token bills, and induce lost-in-the-middle degradation, production agents employ recursive summarization, semantic memory retrieval, hierarchical pruning, and external file scratchpads.

Math & Tradeoffs→
M5-093NLP & Large Language ModelsAgents & Tool Use
Hard

Model Context Protocol (MCP) and Tool Ecosystem Standardization

⚡ One-Sentence Answer

The Model Context Protocol (MCP) establishes an open, standardized client-server architecture that decouples LLM applications from external tools and data sources, transforming custom $N \times M$ point-to-point integrations into a modular $N + M$ ecosystem.

Math & Tradeoffs→
M5-094NLP & Large Language ModelsAgents & Tool Use
Hard

Agent Failure Modes and Robust Recovery Mechanisms

⚡ One-Sentence Answer

Autonomous agents suffer from characteristic operational breakdowns—infinite looping, hallucinated tools, ignored observations, premature stopping, and goal drift—which production systems counter using structured reflection, programmatic verification, checkpoints, and human intervention.

Math & Tradeoffs→
M5-095NLP & Large Language ModelsAgents & Tool Use
Hard

Agentic Reinforcement Learning: Multi-Step Decision-Making and Tool Optimization

⚡ One-Sentence Answer

Agentic Reinforcement Learning formalizes tool-use and multi-step reasoning as a Markov Decision Process, training models via outcome-based policy optimization (e.g., PPO, GRPO) to overcome delayed sparse rewards, non-differentiable environments, and temporal credit assignment.

Math & Tradeoffs→
M5-096NLP & Large Language ModelsAgents & Tool Use
Hard

Challenges in GUI-Based Computer-Use Agents

⚡ One-Sentence Answer

Computer-use agents interact directly with operating system graphical interfaces via screenshot perception and mouse-keyboard actions, facing severe challenges in pixel-level visual grounding, massive continuous action spaces, irreversible side effects, and slow evaluation.

Math & Tradeoffs→