sleepyeldrazi

91 karmajoined June 3, 2021On HN

Personal projects at https://git.kokoham.com/sleepy . Trying to optimize LLM inference frameworks for local models in speed, and explore interesting quants for size.

Recent submissions

DeepSeek V4 Flash optimized framework and model variants for DGX Spark github.com/sleepyeldrazi
3sleepyeldrazi2mo1 comment
Ask HN: Local model experiences with 'high-reasoning distill' finetunes
2sleepyeldrazi3modiscuss
The only non-LLM-generated file in my repo github.com/sleepyeldrazi
2sleepyeldrazi5mo1 comment

All submissions and comments on Hacker News.