Try "Computing: a Concise History" by Paul Ceruzzi is inexpensive.

Best bet is visit the Computer History Museum in Mountain View, CA.

There is "A New History of Modern Computing" that came out last year by Ceruzzi and Thomas Haight (I have not read it).