RAM and i/o will certainly make the biggest difference for the average person or engineer. That and HID's and your display.

My computer before this one at its core was not the latest/greatest Mac Pro, but I had upgraded parts (RAM, video, HD) which made the biggest difference.