Comment on LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023parentComments−throwawaymaths2ypip install vllm, boom you have an openapi-compatible webserver. No further action necessary.−JimDabell2yNo, there is further action necessary. If you want any kind of decent performance, you need to run it with an appropriate GPU. This is not true of spaCy, which makes spaCy easier to deploy.
Comments
pip install vllm, boom you have an openapi-compatible webserver. No further action necessary.
No, there is further action necessary. If you want any kind of decent performance, you need to run it with an appropriate GPU. This is not true of spaCy, which makes spaCy easier to deploy.