Comment on Intuition and Implementations for Gated Linear NetworksparentComments−aiwabdnOP6yMain reason for now is that the cosine similarity used as context function is not suitable for natural images like those in Imagenet. We are experimenting some extensions based on convolutions for such use cases.−p1esk6yWhat would you say is the best real world application for this class of networks?−aiwabdnOP6yPossibly some scenarios in RL where online learning is involved
Comments
Main reason for now is that the cosine similarity used as context function is not suitable for natural images like those in Imagenet. We are experimenting some extensions based on convolutions for such use cases.
What would you say is the best real world application for this class of networks?
Possibly some scenarios in RL where online learning is involved