Skip to content

Comment on The Forward-Forward Algorithm: Some Preliminary Investigations [pdf]parent

Comments

Is this really just Hebbian learning? That's often stated as "cells that fire together wire together", and I can see how that can line up with FF increasing the 'goodness' of actual data. But decreasing the 'goodness' of negative data seems like a qualitatively different mechanism.

What you are saying is half truth. If a cell excites (or inhibits) another cell repeatedly enough that its ability to excite (or inhibit) that neighboring cell improves over time.

"fire together" originally meant fire in same direction, but Hebb's rule was extended quite early to mean that if some cells inhibit some others too often, wiring in that direction will get stronger.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.