I personally made a quake 2 bot using neural networks in 1999, I think it had several hundred neurons and several thousand 'synapses' (parameters). At the time that felt like a lot of parameters. Computation wasn't much of a limit though, I could run several NNs faster than realtime.