Comment on Show HN: Local LLM on a Pi 4 controlling hardware via tool callingparentComments−stfurkanOP4moCurrently I get around 2 tok/s on the 4B model, and 4-5 tok/s on the 1.7B model.
Comments
Currently I get around 2 tok/s on the 4B model, and 4-5 tok/s on the 1.7B model.