AnalysisAI Models
7 days ago
Human-Like Neural Nets by Catapulting
Gwern's blog post introduces 'catapulting', a training technique inspired by human learning that periodically resets model parameters. The method helps escape local minima and improves generalization. It achieves better performance on standard benchmarks.