| Ask HN: Is anybody using llama.cpp for production? | ||
| 2 points by HardikVala 11 minutes ago | hide | past | favorite | discuss | ||
Considering the server version of llama.cpp for a commercial use case over bulkier options like vllm. But wondering if it's been battle-tested in production environments. | ||
.png)


