Comment on Show HN: Shoggoth Mini – A soft tentacle robot powered by GPT-4o and RLparentComments−jszymborski1yIf Qwen 0.6B is suitable, then it could fit in 576MB of VRAM[0].https://huggingface.co/unsloth/Qwen3-0.6B-unsloth-bnb-4bit−numpad01yor on a single Axera AX630C module: https://www.youtube.com/watch?v=cMF6OfktIGg&t=25s
Comments
If Qwen 0.6B is suitable, then it could fit in 576MB of VRAM[0].
https://huggingface.co/unsloth/Qwen3-0.6B-unsloth-bnb-4bit
or on a single Axera AX630C module: https://www.youtube.com/watch?v=cMF6OfktIGg&t=25s