Comment on Benchmarking Pocket-Scale InferenceComments−hxii13dI’ve been running this level of models through a personal benchmark on a RX6750XT.I am hoping to get to the point of being able to run a personal assistant agent with tools at its disposal.The results are largely the same, with some outliers.Results can be seen here: https://0xff.nu/hexbench/
Comments
I’ve been running this level of models through a personal benchmark on a RX6750XT.
I am hoping to get to the point of being able to run a personal assistant agent with tools at its disposal.
The results are largely the same, with some outliers.
Results can be seen here: https://0xff.nu/hexbench/