AI Roadmap/Layer 01 · 01. Semiconductor & Physical Infrastructure
1.4

1.4 Advanced Packaging, Chiplets & High-Speed Memory

CoWoS, SoIC, 2.5D/3D wafer-level packaging, Chiplet heterogeneous interconnects (UCIe), HBM3e/HBM4 high-bandwidth memory, DDR5 controllers, and high-density packaging yield.

Advanced Packaging & Chiplet Integration

Overcoming reticle limits: TSMC CoWoS / SoIC, Intel EMIB / Foveros, silicon interposers, through-silicon vias (TSV), micro-bumps & hybrid bonding, UCIe die-to-die standard, and advanced OSAT assembly.

🏢 Companies
TSMCIntelSamsungASEAmkorJCET
🛠️ Tech Stack
CoWoSChiplet2.5D/3D PackagingTSVHybrid BondingUCIeInterposerOSAT
💼 Roles & Salary
Package Design Engineer、Chiplet Integration Engineer、Packaging Process Engineer、SI/PI Engineer
💰 $195K - $420K / year (Advanced Packaging & Chiplets) | ¥480K - ¥1.25M / year
📚 Prerequisites: 2.5D/3D Packaging & Interposers • UCIe & Die-to-Die Protocols • Thermo-mechanical Stress & CFD • Package-level SI/PI Analysis

HBM & High-Speed Memory Subsystems

Conquering LLM training & inference memory walls: HBM3e/HBM4 3D DRAM die stacks, 1024-bit+ ultra-wide channels, MR-DIMM/CXL memory expansion, and high-performance memory controllers & PHYs.

🏢 Companies
SK HynixSamsungMicronRambus
🛠️ Tech Stack
HBM3eHBM4Memory WallDDR5 / LPDDR5XMemory ControllerCXLMemory BandwidthECC
💼 Roles & Salary
Memory Architect、HBM Design Engineer、Memory Controller Engineer
💰 $210K - $450K / year (HBM & Memory Arch) | ¥550K - ¥1.45M / year
📚 Prerequisites: DRAM Architecture & 3D TSV Stacking • HBM/DDR Protocol & Timing • Memory Controller Arbitration & Scheduling • Memory Bandwidth & Latency Modeling