FWIW, I've heard that Google once had no managers. The person I heard it from started around 2002, when Google was already an order of magnitude bigger than 37signals. So while it obviously doesn't work for all size companies, it seems that you can get fairly big and still do okay without managers.