A OpenAI API compatible REST server for llama.
Why do you think that https://github.com/eth-sri/lmql is a good alternative to llama-api-server
A OpenAI API compatible REST server for llama.
Why do you think that https://github.com/eth-sri/lmql is a good alternative to llama-api-server