Skip to content

Comment on Benchmarking Pocket-Scale Inference

Comments

I’ve been running this level of models through a personal benchmark on a RX6750XT.

I am hoping to get to the point of being able to run a personal assistant agent with tools at its disposal.

The results are largely the same, with some outliers.

Results can be seen here: https://0xff.nu/hexbench/

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.