I can highly recommend https://agentsview.io/ for a way to dig into your LLM usage. It reads your local conversation files and provides a ton of visualizations as well as the ability to dig into each conversation and see all the tool calls/etc. It's incredibly powerful.
Looks interesting. One of the angles that I approached while building this was focusing on cache misses. Not sure if this shows much info about this category. My tool is also local only + detecting changes and syncing into a sqlite db
yeah i tried to do even deeper and classify the types of misses and their monetary cost. for example, I was using Fable at work, and a single TTL miss (responding an hour and half later), cost $6 for one message
Comments
I can highly recommend https://agentsview.io/ for a way to dig into your LLM usage. It reads your local conversation files and provides a ton of visualizations as well as the ability to dig into each conversation and see all the tool calls/etc. It's incredibly powerful.
Looks interesting. One of the angles that I approached while building this was focusing on cache misses. Not sure if this shows much info about this category. My tool is also local only + detecting changes and syncing into a sqlite db
Yes, it does show cached vs not:
- https://cs.joshstrange.com/jzwC4Z9y
- https://cs.joshstrange.com/nynGc5V9
yeah i tried to do even deeper and classify the types of misses and their monetary cost. for example, I was using Fable at work, and a single TTL miss (responding an hour and half later), cost $6 for one message