VSC Continue.dev with own Rest API

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

Check out the llama.cpp project, it's pretty straight forward to install and setup (dm me if you want help). After that, spin-up a llama.cpp API using these instructions. At this point, you should have an API running on your machine, and you can make a quick sanity check by visiting http://localhost:8080. Once that's all set-up you can use the VSC extension's guide on how to connect the API to your editor. Enjoy!

• continue

  18 10,740 10.0 TypeScript

  ⏩ Open-source VS Code and JetBrains extensions that enable you to easily create your own modular AI software development system

  

In this Continue.dev file https://github.com/continuedev/continue/blob/preview/server/continuedev/libs/llm/llamacpp.py the request to llama.cpp is implemented.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project