Patrick(patio11) released an opensource rails plugin to do the A/B testing. I haven't used it but he can probably chime in or you can look at his blog about his results.

http://www.bingocardcreator.com/abingo