Comment on GigaToken: ~1000x faster Language model tokenizationparentComments−ludston1moIt depends on whether or not latency is the constraint of throughput in your circumstances.
Comments
It depends on whether or not latency is the constraint of throughput in your circumstances.