What makes you think that the rating software is "automated"? I bet it's just a tool used by the YC partners. It could be as simple as a human-assisted radix sort, so the 1000 applications first get binned into 10 bins, then each of the apps in each bin are further subdivided on a 1 to 10 scale, etc.