Thanks for this link. Because of this article, I had claude stand up a llama.cpp container next to my already running ollama container. It ran side by side tests with the same model and parameters, and the results blew ollama out of the water. I’m in the process of moving hermes and openwebgui over to the llama.cpp instance to see how it goes day to day.
- 0 Posts
- 5 Comments
Joined 1 年前
Cake day: 2025年6月12日
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
2·11 个月前The real hero
Thanks! I’ll look into this. I’m a bit limited at 12GB of VRAM right now.