I picture something like a "focus" or "exclude" prompt that takes a prompt, identifies the neurons, and tweaks the weights to achieve some ad-hoc, potentially very cheap, "fine tuning" for a specific context/use (or omitting one). This seems relatively huge, effectively a super system prompt. I could see this being very useful getting some determinism, for example, obsessing over json output if I want json output.
Comments
This cracks me up. There's really cool implications with this research, but I think the fun value might actually outweigh it.
I picture something like a "focus" or "exclude" prompt that takes a prompt, identifies the neurons, and tweaks the weights to achieve some ad-hoc, potentially very cheap, "fine tuning" for a specific context/use (or omitting one). This seems relatively huge, effectively a super system prompt. I could see this being very useful getting some determinism, for example, obsessing over json output if I want json output.