deep-learning

58 entries in Machine Learning & AI.

• Convolutional neural networkWeight-sharing kernelscanondeep-learning
• LeNetstandalonespecialistdeep-learning
• AlexNetReLU and dropoutspecialistdeep-learning
• VGGStacked 3x3 convolutionsspecialistdeep-learning
• ResNetResidual skip connectionscanondeep-learning
• Inception networkMulti-scale parallel convolutionsspecialistdeep-learning
• DenseNetDense feature concatenationspecialistdeep-learning
• EfficientNetCompound scalingspecialistdeep-learning
• MobileNetDepthwise separable convolutionsspecialistdeep-learning
• U-NetSkip-connected encoder-decoderstandarddeep-learning
• Mask R-CNNRegion proposals plus masksspecialistdeep-learning
• YOLOSingle-shot grid detectionstandarddeep-learning
• Faster R-CNNRegion proposal networkspecialistdeep-learning
• Recurrent neural networkBackpropagation through timecanondeep-learning
• LSTMGated memory cellscanondeep-learning
• GRUUpdate-reset gatingstandarddeep-learning
• Bidirectional RNNstandalonestandarddeep-learning
• Sequence-to-sequenceEncoder-decoder with attentioncanondeep-learning
• TransformerMulti-head self-attentioncanondeep-learning
• Vision transformerImage patch tokensstandarddeep-learning
• BERTMasked language modelingcanondeep-learning
• GPTAutoregressive pretrainingcanondeep-learning
• Mixture of expertsTop-k gated routingstandarddeep-learning
• Flash attentionTiled IO-aware softmaxspecialistdeep-learning
• Rotary position embeddingstandalonespecialistdeep-learning
• AutoencoderReconstruction bottleneckcanondeep-learning
• Variational autoencoderReparameterization trickcanondeep-learning
• Generative adversarial networkMinimax discriminator gamecanondeep-learning
• Wasserstein GANEarth-mover criticstandarddeep-learning
• StyleGANStyle-modulated synthesisspecialistdeep-learning
• Diffusion modelDenoising score matchingcanondeep-learning
• DDPMMarkov denoising chainstandarddeep-learning
• DDIM samplingNon-Markovian fast samplingspecialistdeep-learning
• Latent diffusionAutoencoder latent spacestandarddeep-learning
• Classifier-free guidancestandalonespecialistdeep-learning
• Normalizing flowInvertible coupling layersstandarddeep-learning
• Neural ODEAdjoint sensitivityspecialistdeep-learning
• Graph neural networkMessage passingcanondeep-learning
• Graph convolutional networkSpectral neighborhood aggregationstandarddeep-learning
• GraphSAGESampled neighbor aggregationstandarddeep-learning
• Graph attention networkAttention-weighted neighborsstandarddeep-learning
• Contrastive learningInfoNCE lossstandarddeep-learning
• SimCLRAugmentation-pair contrastspecialistdeep-learning
• Momentum contrastQueue and momentum encoderspecialistdeep-learning
• Masked autoencoderHigh-ratio patch maskingspecialistdeep-learning
• Knowledge distillationSoft-label teacher matchingstandarddeep-learning
• Network pruningMagnitude-based sparsificationstandarddeep-learning
• Quantization-aware trainingstandalonespecialistdeep-learning
• LoRALow-rank adapter updatesstandarddeep-learning
• Adapter tuningBottleneck adapter layersspecialistdeep-learning
• Neural architecture searchReinforcement controllerspecialistdeep-learning
• DARTSDifferentiable architecture relaxationspecialistdeep-learning
• Gradient clippingGlobal-norm rescalingstandarddeep-learning
• Layer normalizationstandalonestandarddeep-learning
• Residual dropoutstandalonespecialistdeep-learning
• Label smoothingstandalonespecialistdeep-learning
• Mixup augmentationConvex sample interpolationspecialistdeep-learning
• Word embedding pretrainingNegative samplingstandarddeep-learning