Comment on So, you want to chunk really fast?Comments−brene8moDo you see this project merge with the Chonkie at some point? Or do you intend to keep it separate?−snyyOP8moMemchunk is already in Chonkie as the `FastChunker`To install: pip install chonkie[fast]``` from chonkie import FastChunkerchunker = FastChunker(chunk_size=4096) chunks = chunker(huge_document) ```
Comments
Do you see this project merge with the Chonkie at some point? Or do you intend to keep it separate?
Memchunk is already in Chonkie as the `FastChunker`
To install: pip install chonkie[fast]
``` from chonkie import FastChunker
chunker = FastChunker(chunk_size=4096) chunks = chunker(huge_document) ```