Comment on Launch HN: Chonkie (YC X25) – Open-Source Library for Advanced ChunkingparentComments−snyyOP1yPretty much what you described. Convert the PDF to Markdown, join content across pages so that its all one string, then chunk it. Our evals show this approach works best.
Comments
Pretty much what you described. Convert the PDF to Markdown, join content across pages so that its all one string, then chunk it. Our evals show this approach works best.