PygmalionAI's large-scale inference engine
Why do you think that https://github.com/LostRuins/koboldcpp is a good alternative to aphrodite-engine
PygmalionAI's large-scale inference engine
Why do you think that https://github.com/LostRuins/koboldcpp is a good alternative to aphrodite-engine