Skip to content

Comment on LLama.cpp Got Screwd

Comments

We are heading towards a closed and monitored system, better said a proprietary one soon. Get the last genuine llama.cpp build before to late b9925.

The CLI now asking for access to load the model?

Here the change that screw everything:

b9927 @github-actions github-actions released this 17 hours ago b9927 c264f65 Details cli : move to HTTP-based implementation (#24948)

cli: move to HTTP-based implementation

wip

working

remote server ok

cli support router mode

Co-authored-by: Piotr Wilkin ilintar@gmail.com

case: router with only one model

Apply suggestions from code review

Co-authored-by: Piotr Wilkin (ilintar) piotr.wilkin@syndatis.com

remove outdated comment

use destructor instead

add ftype

cli-view --> cli-ui

pimpl

no more json in header

nits fixes

also show model aliases

Adios llama.cpp.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.