Show HN: I built local copilot alternative using Codellama

• llama-coder

  1 1,111 8.3 TypeScript

  Replace Copilot local AI

Hey, HN!

I was trying to find a good Copilot alternative since my experience with copilot degraded a lot and recent OpenAI drama leaves me no hope for improvement and i decided to take a look at self-hosting options. At the same time Copilot net is a small one - just 12b parameters and 2k of context. You can run much bigger networks locally in 2023.

I have figured out that there are no good local options: most of the VS Code plugins simply connect neural networks to the code while copilot has extensive post and pre processing steps. Some of them still work with original copilot plugin (ie sends data to MS), some require complicated setup to make it work.

I implemented very basic ones to check if this would work and in my experience it works really good and i wanted to share it on HN. Feedback is appreciated!

Sources are here: https://github.com/ex3ndr/llama-coder

• tabby

  24 17,192 9.9 Rust

  Self-hosted AI coding assistant

  

Looks interesting! What are the main differences between this and https://github.com/TabbyML/tabby ?

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project