Skip to content

Comment on Does Speaking to Agents Like Cavemen Save 65% of Tokens? We Test

Comments

Does anyone more familiar with the technology know if these AI models treat abugidas like Thai or abjads like Arabic differently when it comes to token usage?

Specifically abjads since as far as I am aware their difference from alphabetical and abugida scripts is that they infer the vowels instead of explicitly marking them.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.