Skip to content

Show HN: Pulpie – Pareto-Optimal Models for Cleaning the Web

usefeyn.com
1 pointsnyydiscuss
On HN

The idea for Pulpie came to us when building a deep research harness. All Search APIs return noisy content containing ads, navigational elements, and sidebars. In one instance, an ad for "Gemini on Pixel" made its way into our search results. The ad copy was then passed into LLM context, where it was used in the final answer served to the user.

Unclean data is harmful to model intelligence. In pre training, it pollutes data the model learns from. At inference, it confuses a model.

We built Pulpie to make clean data available for cheap. The blog goes over our process. Happy to answer any questions

Comments

No comments yet.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.