Comment on A new link to an old model could crack the mystery of deep learningComments−mvcalder4yWhen I first read about the NTK I was motivated to try an experiment to see if the kernel depended on where in the parameter space one evaluated it. I was surprised to see in my simple example the answer was "no". Here is a write up I did:https://arxiv.org/pdf/2104.05874.pdf
Comments
When I first read about the NTK I was motivated to try an experiment to see if the kernel depended on where in the parameter space one evaluated it. I was surprised to see in my simple example the answer was "no". Here is a write up I did:
https://arxiv.org/pdf/2104.05874.pdf