Carnegie Mellon Study on Evaluating AI

Hi Hacker News!

We are researchers at Carnegie Mellon studying how data scientists evaluate their AI/ML systems. For this study, we are interviewing data scientists at small companies/consultancies/non-profits to understand the major challenges and ideal solutions for better evaluating AI systems, especially beyond aggregate metrics like accuracy and F1 score.

The study will take up to an hour over Zoom and be compensated with a $20 Amazon gift card. If you're interested in participating please fill out this short form!

https://forms.gle/38ChADjgMoVpNi3V8