Personally, I would probably get something like a Raspberry Pi (if it's beefy enough) with a Linux distro which runs straight from RAM just for Bitcoin transactions.

This is basically exactly what you're talking about: http://piperwallet.com