Skip to content

Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparent

Comments

Well that makes sense. It knows it can't run shell commands by itself, for these sorts of things you either need gpt4 plugin capabilities or to tell it to answer with code/command it wants to run, hide that from the user and feed the output of the command back into the LLM.

Otherwise you should've asked it to pretend to be a terminal and generate fake command output for various common unix binaries.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.