AI Roadmap/Layer 02 · 02. Compute, Network & Cloud Infrastructure
2.2

2.2 AI Fabric, Interconnect & Optical Networking

NVLink/NVSwitch fabrics, InfiniBand NDR/XDR, RoCEv2 lossless Ethernet, PFC/ECN congestion control, NCCL collectives tuning, and 800G/1.6T high-speed optics.

NVLink & InfiniBand / RoCE RDMA Fabrics

1.8TB/s inter-GPU NVLink, cross-node zero-copy RDMA, Priority Flow Control (PFC), ECN/DCQCN congestion control, NCCL collective tuning, and DPU/SmartNIC hardware offloading.

🏢 Companies
NVIDIAAristaBroadcomCiscoMarvellAstera LabsCredo
🛠️ Tech Stack
NVLinkInfiniBand NDRRoCEv2RDMA VerbsNCCLPFC / ECNDPU OffloadLossless Ethernet
💼 Roles & Salary
RDMA Systems Engineer、Network Engineer、Network Performance Engineer
💰 $210K - $440K / year (RDMA & AI Fabrics) | ¥550K - ¥1.4M / year
📚 Prerequisites: RDMA Programming (libibverbs/UCX) • NCCL Source & Collective Algorithms • Lossless Ethernet QoS & PFC/ECN • DPU / SmartNIC Architecture

800G/1.6T Optics & Network Telemetry

800G/1.6T high-density optical transceivers (OSFP/QSFP-DD), Co-Packaged Optics (CPO), silicon photonics, In-band Network Telemetry (INT), and real-time BER link quality monitoring.

🏢 Companies
AristaCiscoCoherentLumentumBroadcomCredo
🛠️ Tech Stack
800G/1.6T OpticsSilicon PhotonicsCPOOSFPIn-band TelemetryEye DiagramBER Monitoring
💼 Roles & Salary
Optical Systems Engineer、Network Performance Engineer、Network Engineer
💰 $200K - $420K / year (Optical Networks) | ¥500K - ¥1.3M / year
📚 Prerequisites: High-speed Optical Fiber & Link Budgets • Eye Diagram & BER Testing • Network Telemetry & sFlow Specs • Spine-Leaf Data Center Topologies