Is there such a thing as local Llamas integrated into VSCode?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • oasis

    Local LLaMAs/Models in VSCode (by ChuloAI)

  • The new version already works locally: https://github.com/paolorechia/oasis

  • fauxpilot

    FauxPilot - an open-source alternative to GitHub Copilot server

  • FauxPilot open source Copilot alternative using Triton Inference Server

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • locai

    Connect to Kobold API through VS Code

  • It is. I have simple one, that prints output into its own output output channel, though I didn't bother documenting it as I use github as backup, but you can check it I guess.

  • refact

    WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

  • I’m experimenting this week with the https://refact.ai/. You can plug a few different models, including the starcoder. Still a bit buggy, but it is a start.

  • starcoder.cpp

    C++ implementation for 💫StarCoder

  • starcoder.cpp

  • GPTQ-for-SantaCoder

    4 bits quantization of SantaCoder using GPTQ

  • GPTQ-for-SantaCoder 4bit quantization for SantaCoder

  • supercharger

    Supercharge Open-Source AI Models

  • supercharger Write Software + unit tests for you, based on Baize-30B 8bit, using model parallelism

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • autodoc

    Experimental toolkit for auto-generating codebase documentation using LLMs

  • Autodoc toolkit that auto-generates codebase documentation using GPT-4 or Alpaca, and can be installed in a git repository in about 5 minutes.

  • developer

    the first library to let you embed a developer agent in your own app!

  • smol-ai developer a personal junior developer that scaffolds an entire codebase with a human-centric and coherent whole program synthesis approach using <200 lines of Python and Prompts.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts