Show HN: Giskard – Testing framework dedicated to LLMs and Tabular ML models

15 pointsalexcombessie3 years ago8 comments

Hey, Giskard team member here! I am around to discuss and read your feedback.

I’ve worked in particular on automatic scanning of ML models for bugs and problems, the idea was to systematically scan for general issues and automatically find segments of data on which the model performs worse than average. If you have questions, I am happy to discuss here.

hugolsqrn 3y

Very exciting to see Giskard coming around to bring trust to LLMs!

alexcombessieOP3y

Thanks! LLM testing is a specific challenge, we’re interested in your feedback on our alpha version.

Here’s a notebook to try it: https://docs.giskard.ai/en/latest/reference/notebooks/llm_co...

jplassmann 3y

Awesome!! Exactly what I was looking for!

alexcombessieOP3y

Thanks! We’re interested in your feedback as it’s still a beta version.

Here is our documentation to get started: https://docs.giskard.ai/

mxcrbn 3y

Interesting stuff!