Very interesting read, I wonder if Twitter does it in a similar way.

Anyone who knows where to learn more about the system design they use, with the pre-processor, parser, scorer, and ranker?

How do these interact? What's the respective input and output?

Links to some similar system with more in-depth on this area would be appreciated.