Sobolev Training Boosts Convergence of ReLU Neural Networks

Sobolev training adds a derivative term to the loss and study shows it speeds convergence for shallow ReLU networks with Gaussian inputs. Experiments show fewer epochs for lower error. Read more: getnews.me/sobolev-training-boosts-... #sobolevtraining #relu