A
Aug 2, 2026Adam vs AdamW: When Weight Decay Actually Matters
The 0.2% Accuracy Drop That Cost Us 3 Days Swapping Adam for AdamW in a ResNet-50 training...
Aug 2, 20261 min read0 reactions0 comments
Back to articles
Tag archive
#weightdecay
N
Mar 13, 2026Neural Network Regularization: Fighting Overfitting
"Learning without thought is labor lost." --Confucius 99% Accuracy That Means...
Mar 13, 20264 min read0 reactions0 comments