A OpenAI API compatible REST server for llama.
Why do you think that https://github.com/microsoft/guidance is a good alternative to llama-api-server
A OpenAI API compatible REST server for llama.
Why do you think that https://github.com/microsoft/guidance is a good alternative to llama-api-server