⚡ LLMsID: classic-tasks

Classic NLP Tasks

Q: LLM vs BERT for classification: accuracy, cost, latency, and cold-start trade-offs?

【Classic NLP Tasks 核心考点 1】LLM vs BERT for classification: accuracy, cost, latency, and cold-start trade-offs?。技术解析：Definition: pre- vs post-LLM paradigms for four classic tasks. (1) Text classification — before: TF-IDF/BOW + LR/GBDT feature engineering, or BERT's [CLS] into \text{softmax}(W^\top h_{\text{[CLS]}}); after: zero/few-shot prompts assign labels, or distill into a small model for c... 完整推导与工程落地见：https://talentme.airsota.com/resources/tech/roadmap/mindmap/LLM/card/classic-tasks

Q: Sequence-labeling NER (BIO, BiLSTM-CRF) vs LLM extraction: pros and cons of each?

【Classic NLP Tasks 核心考点 2】Sequence-labeling NER (BIO, BiLSTM-CRF) vs LLM extraction: pros and cons of each?。技术解析：Definition: pre- vs post-LLM paradigms for four classic tasks. (1) Text classification — before: TF-IDF/BOW + LR/GBDT feature engineering, or BERT's [CLS] into \text{softmax}(W^\top h_{\text{[CLS]}}); after: zero/few-shot prompts assign labels, or distill into a small model for c... 完整推导与工程落地见：https://talentme.airsota.com/resources/tech/roadmap/mindmap/LLM/card/classic-tasks

Q: Why was NMT replacing SMT a milestone, and what role did BLEU play?

【Classic NLP Tasks 核心考点 3】Why was NMT replacing SMT a milestone, and what role did BLEU play?。技术解析：Definition: pre- vs post-LLM paradigms for four classic tasks. (1) Text classification — before: TF-IDF/BOW + LR/GBDT feature engineering, or BERT's [CLS] into \text{softmax}(W^\top h_{\text{[CLS]}}); after: zero/few-shot prompts assign labels, or distill into a small model for c... 完整推导与工程落地见：https://talentme.airsota.com/resources/tech/roadmap/mindmap/LLM/card/classic-tasks

Q: How do you design Map-Reduce summarization for very long documents, and how do you mitigate information loss at merge?

【Classic NLP Tasks 核心考点 4】How do you design Map-Reduce summarization for very long documents, and how do you mitigate information loss at merge?。技术解析：Definition: pre- vs post-LLM paradigms for four classic tasks. (1) Text classification — before: TF-IDF/BOW + LR/GBDT feature engineering, or BERT's [CLS] into \text{softmax}(W^\top h_{\text{[CLS]}}); after: zero/few-shot prompts assign labels, or distill into a small model for c... 完整推导与工程落地见：https://talentme.airsota.com/resources/tech/roadmap/mindmap/LLM/card/classic-tasks

Q: LLM-to-small-model distillation pipeline: how do you build training data and measure distillation loss?

【Classic NLP Tasks 核心考点 5】LLM-to-small-model distillation pipeline: how do you build training data and measure distillation loss?。技术解析：Definition: pre- vs post-LLM paradigms for four classic tasks. (1) Text classification — before: TF-IDF/BOW + LR/GBDT feature engineering, or BERT's [CLS] into \text{softmax}(W^\top h_{\text{[CLS]}}); after: zero/few-shot prompts assign labels, or distill into a small model for c... 完整推导与工程落地见：https://talentme.airsota.com/resources/tech/roadmap/mindmap/LLM/card/classic-tasks

经典 NLP 任务

🎯Core Definition

pre- vs post-LLM paradigms for four classic tasks. (1) Text classification — before: TF-IDF/BOW + LR/GBDT feature engineering, or BERT's [CLS] into

\text{softmax}(W^\top h_{\text{[CLS]}})

; after: zero/few-shot prompts assign labels, or distill into a small model for cost. (2) NER — before: sequence labeling BiLSTM-CRF over BIO tags; after: LLMs emit JSON entity lists, unconstrained label sets, new entity types with zero training. (3) MT — before: SMT (phrase statistics) to NMT (Seq2Seq + Attention, BLEU); after: one multilingual model plus glossary constraints in-context. (4) Summarization — before: extractive (TextRank) and abstractive (BART/Pegasus, ROUGE); after: Map-Reduce chunked summarization for very long documents.

💡Use Cases

tech-selection when migrating to LLMs; keep traditional small models where throughput, latency, or privacy dominate; a classic interview question — classifying 10M customer-support tickets, balancing LLM vs fine-tuned small models.

⚡Key Problems Solved

the traditional paradigm needs task-specific labeled data, models, and feature engineering — slow cold starts per task. The LLM paradigm reduces task differences to prompt differences: few-shot cold start and reuse, at the cost of latency/cost/stability — which is why production often runs the hybrid "LLM annotates → distill to a small model" route.

🎯5 High-Frequency Exam Points

LLM vs BERT for classification: accuracy, cost, latency, and cold-start trade-offs?

Sequence-labeling NER (BIO, BiLSTM-CRF) vs LLM extraction: pros and cons of each?

Why was NMT replacing SMT a milestone, and what role did BLEU play?

How do you design Map-Reduce summarization for very long documents, and how do you mitigate information loss at merge?

LLM-to-small-model distillation pipeline: how do you build training data and measure distillation loss?

📖 In-depth Guide:📄 nlp-tasks-and-ner →

Updated 2026-08-12

🎯

Test Your Knowledge: Practice Questions for "Classic NLP Tasks"

Single choice pitfall questions with instant feedback and mistake tracking.

🚀 Start Card Practice ➔

← Previous CardContext Engineering

🔗 More LLMs Knowledge Cards

Agent & Tool Calling Alignment Tax & Preference Data Scaled Dot-Product Attention Attention Variants MHA/MQA/GQA