Is there such a thing as local Llamas integrated into VSCode?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Judoscale - Save 47% on cloud hosting with autoscaling that just works
Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
judoscale.com
featured
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured
  1. oasis

    Local LLaMAs/Models in VSCode (by ChuloAI)

    The new version already works locally: https://github.com/paolorechia/oasis

  2. Judoscale

    Save 47% on cloud hosting with autoscaling that just works. Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.

    Judoscale logo
  3. fauxpilot

    FauxPilot - an open-source alternative to GitHub Copilot server

    FauxPilot open source Copilot alternative using Triton Inference Server

  4. locai

    Connect to Kobold API through VS Code

    It is. I have simple one, that prints output into its own output output channel, though I didn't bother documenting it as I use github as backup, but you can check it I guess.

  5. refact

    AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

    I’m experimenting this week with the https://refact.ai/. You can plug a few different models, including the starcoder. Still a bit buggy, but it is a start.

  6. starcoder.cpp

    C++ implementation for 💫StarCoder

    starcoder.cpp

  7. GPTQ-for-SantaCoder

    4 bits quantization of SantaCoder using GPTQ

    GPTQ-for-SantaCoder 4bit quantization for SantaCoder

  8. supercharger

    Supercharge Open-Source AI Models

    supercharger Write Software + unit tests for you, based on Baize-30B 8bit, using model parallelism

  9. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  10. autodoc

    Experimental toolkit for auto-generating codebase documentation using LLMs

    Autodoc toolkit that auto-generates codebase documentation using GPT-4 or Alpaca, and can be installed in a git repository in about 5 minutes.

  11. developer

    the first library to let you embed a developer agent in your own app!

    smol-ai developer a personal junior developer that scaffolds an entire codebase with a human-centric and coherent whole program synthesis approach using <200 lines of Python and Prompts.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • 27-Mar-2023

    3 projects | /r/dailyainews | 11 Apr 2023
  • Autodoc: A toolkit for auto-generating codebase documentation using LLMs, like GPT-4

    1 project | /r/programming | 25 Mar 2023
  • Autodoc: Toolkit for auto-generating codebase documentation using LLMs

    1 project | /r/patient_hackernews | 24 Mar 2023
  • Autodoc: Toolkit for auto-generating codebase documentation using LLMs

    1 project | /r/hackernews | 24 Mar 2023
  • Autodoc: Toolkit for auto-generating codebase documentation using LLMs

    1 project | /r/hypeurls | 24 Mar 2023

Did you know that Python is
the 2nd most popular programming language
based on number of references?