Skip to content

Comment on State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU accelerationparent

Comments

How do you talk to llama? It doesn't respond to instructions, so it's a bit complicated to have it extract keywords and/or summarize texts. Can you please share examples of llama prompts?

See my sibling comment for a bash script to launch it :)

Edit: I have not tried to use it for extracting keywords / summarizing text. Perhaps I shall experiment a bit with it.

Ah yes I can see the prompt. It's very verbose. I'll try to figure out how to use a verbose prompt to make llama extract keywords/summarize.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.