Skip to content

Comment on Mesh LLM: distributed AI computing on irohparent

Comments

Even if transport is encrypted, the LLM computations will always be clear text, right?

Indeed, it's in-transit-encrypted so snoopers won't be able to see it, but it's not E2E encrypted nor in-process encrypted, the one's doing the inference could obviously see the input/output.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.