Comment on Releasing 3B and 7B RedPajamaparentComments−azinman23yDo these red pajama models work with llama.cpp?−anentropic3ythe naming is confusing... these models are aiming to equal or beat LLaMa by reproducing the trainign data and methodology that was used for LLaMaBut the actual model architecture is slightly different, based on PythiaI guess what is needed is a pythia.cpp https://github.com/ggerganov/llama.cpp/issues/742−anentropic3yUpdate: https://github.com/togethercomputer/redpajama.cpp−Joeri3yNo, llama.cpp only works with llama-based models, like base llama, alpaca, vicuna, ...
Comments
Do these red pajama models work with llama.cpp?
the naming is confusing... these models are aiming to equal or beat LLaMa by reproducing the trainign data and methodology that was used for LLaMa
But the actual model architecture is slightly different, based on Pythia
I guess what is needed is a pythia.cpp https://github.com/ggerganov/llama.cpp/issues/742
Update: https://github.com/togethercomputer/redpajama.cpp
No, llama.cpp only works with llama-based models, like base llama, alpaca, vicuna, ...