Rightscale scripts to provision new machines and Fabric to do the software deployments. We pushed a tarball up to S3, downloaded it to all the servers, untar the new deployment into a new directory, and then swap the symlinks/restart nginx either in a cascading fashion or all at once with a maintenance page depending on the complexity of the deployment (and if database changes were needed).