Training stabilization and regularization

Phrasings that mean this problem

Training stabilizationRegularizationClassifier calibrationData augmentationTraining schedulesNeural regularizationOverfitting controlProbability calibrationTraining strategy

deep-learning

• Gradient clippingGlobal-norm rescalingstandarddeep-learning
• Layer normalizationstandalonestandarddeep-learning
• Residual dropoutstandalonespecialistdeep-learning
• Label smoothingstandalonespecialistdeep-learning
• Mixup augmentationConvex sample interpolationspecialistdeep-learning

machine-learning

• Batch normalizationstandalonestandardmachine-learning
• Dropoutstandalonestandardmachine-learning
• Learning rate warmupCosine annealing schedulestandardmachine-learning

model-selection

• Early stoppingValidation-plateau patiencecanonmodel-selection

recommender-causal

• Platt scalingSigmoid calibrationstandardrecommender-causal
• Isotonic calibrationMonotone regressionspecialistrecommender-causal

semi-supervised-meta

• Curriculum learningEasy-to-hard orderingstandardsemi-supervised-meta
• Self-paced learningDifficulty-gated samplingspecialistsemi-supervised-meta