A OpenAI API compatible REST server for llama.
Why do you think that https://github.com/r2d4/rellm is a good alternative to llama-api-server
A OpenAI API compatible REST server for llama.
Why do you think that https://github.com/r2d4/rellm is a good alternative to llama-api-server