Llama.cpp with CUDA Support on Original Jetson Nano (4GB)github.com/kreier 2 pointsAbishek_Muthian5 months ago2 commentsSaveHideCopy link On HNComments−Abishek_MuthianOP5moOriginal title: Llama.cpp with CUDA support on a Jetson NanoEditorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.−politelemon5moNice work, the benchmarks don't look terrible for what it is, especially the prompt processing.
Comments
Original title: Llama.cpp with CUDA support on a Jetson Nano
Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.
Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.