Continue with LocalAI: An alternative to GitHub's Copilot that runs locally

• llama-gpt

  7 10,297 7.4 TypeScript

  A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

  

wodner if you can pair with https://github.com/getumbrel/llama-gpt

• ollama

  192 58,943 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

Continue has a great guide on using the new Code Llama model launched by Facebook last week: https://continue.dev/docs/walkthroughs/codellama

Continue also works with various backends and fine-tuned versions of Code Llama. E.g. for a local experience with GPU acceleration on macOS, continue can be used with Ollama (https://github.com/jmorganca/ollama):

  ollama pull codellama

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

You can absolutely run LLMs without a GPU, but you need to set expectations for performance. Some projects to look into are

  * llama.cpp - https://github.com/ggerganov/llama.cpp

• koboldcpp

  180 3,749 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

* https://github.com/LostRuins/koboldcpp

• code-llama-for-vscode

  5 506 4.6 Python

  Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

Ollama only works on Mac. Here is a portable option:

https://github.com/xnul/code-llama-for-vscode

• twinny

  7 1,514 9.9 TypeScript

  The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.

Suggest a related project