Roadmap

🧠 Deep Learning Mind Map

38 knowledge points · click a node for its structured card

Same color = same guide topic. Hover a node for its dependency chain. Drag and zoom canvas. Export PNG or go fullscreen from the top-right.

Activation FunctionsNormalizationRegularizationConvNetsModern ArchitecturesRNN & BPTTOptimizers & InitTraining NumericsGraph RepresentationGAN Adversarial TrainingTraining DebuggingActivation FunctionsActivation FunctionsClick for definition & exam pointsVanishing/Exploding GradientsVanishing/Exploding GradientsClick for definition & exam pointsLoss FunctionsLoss FunctionsClick for definition & exam pointsBatchNormBatchNormClick for definition & exam pointsLayerNorm & RMSNormLayerNorm & RMSNormClick for definition & exam pointsNorm Methods ComparisonNorm Methods ComparisonClick for definition & exam pointsDropoutDropoutClick for definition & exam pointsLabel SmoothingLabel SmoothingClick for definition & exam pointsWeight Decay & AdamWWeight Decay & AdamWClick for definition & exam pointsData AugmentationData AugmentationClick for definition & exam pointsConvolution BasicsConvolution BasicsClick for definition & exam pointsClassic CNN ArchitecturesClassic CNN ArchitecturesClick for definition & exam pointsDepthwise Separable ConvDepthwise Separable ConvClick for definition & exam pointsReceptive Field & FLOPsReceptive Field & FLOPsClick for definition & exam pointsResNet Skip ConnectionsResNet Skip ConnectionsClick for definition & exam pointsViT & Inductive BiasViT & Inductive BiasClick for definition & exam pointsTransfer LearningTransfer LearningClick for definition & exam pointsRNN & BPTTRNN & BPTTClick for definition & exam pointsLSTM GatingLSTM GatingClick for definition & exam pointsGRUGRUClick for definition & exam pointsSSM & MambaSSM & MambaClick for definition & exam pointsSGD & MomentumSGD & MomentumClick for definition & exam pointsAdam & AdamWAdam & AdamWClick for definition & exam pointsLearning Rate SchedulingLearning Rate SchedulingClick for definition & exam pointsWeight InitializationWeight InitializationClick for definition & exam pointsKaiming Init DerivationKaiming Init DerivationClick for definition & exam pointsGradient ClippingGradient ClippingClick for definition & exam pointsMixed Precision FP16/BF16/FP8Mixed Precision FP16/BF16/FP8Click for definition & exam pointsDDP & Ring-AllReduce (bridge)DDP & Ring-AllReduce (bridge)Click for definition & exam pointsGraph RepresentationGraph RepresentationClick for definition & exam pointsGraph Conv NetworkGraph Conv NetworkClick for definition & exam pointsGraph Attention NetworkGraph Attention NetworkClick for definition & exam pointsGAN Adversarial TrainingGAN Adversarial TrainingClick for definition & exam pointsWGAN & WassersteinWGAN & WassersteinClick for definition & exam pointsVAE & ReparameterizationVAE & ReparameterizationClick for definition & exam pointsTraining DebuggingTraining DebuggingClick for definition & exam pointsAutograd Compute GraphAutograd Compute GraphClick for definition & exam pointsGradient CheckingGradient CheckingClick for definition & exam points
100%
🖱️ Drag to pan · Hover for dependency chain · Click for card
Activation FunctionsBatchNormConvolution BasicsRNN & BPTTSGD & MomentumGraph RepresentationGAN Adversarial TrainingTraining Debugging