Comment on So, you want to chunk really fast?parentComments−snyyOP8moMemchunk is already in Chonkie as the `FastChunker`To install: pip install chonkie[fast]``` from chonkie import FastChunkerchunker = FastChunker(chunk_size=4096) chunks = chunker(huge_document) ```
Comments
Memchunk is already in Chonkie as the `FastChunker`
To install: pip install chonkie[fast]
``` from chonkie import FastChunker
chunker = FastChunker(chunk_size=4096) chunks = chunker(huge_document) ```