GPTQ-for-SantaCoder
4 bits quantization of SantaCoder using GPTQ (by mayank31398)
refact
WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding (by smallcloudai)
| GPTQ-for-SantaCoder | refact | |
|---|---|---|
| 5 | 34 | |
| 54 | 1,448 | |
| - | 5.0% | |
| 8.2 | 9.8 | |
| 12 months ago | 6 days ago | |
| Python | JavaScript | |
| - | BSD 3-clause "New" or "Revised" License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
GPTQ-for-SantaCoder
Posts with mentions or reviews of GPTQ-for-SantaCoder.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-21.
-
What coding llm is the best?
This is on my list of projects to explore but haven't made it here yet: https://github.com/mayank31398/GPTQ-for-SantaCoder
-
Is there such a thing as local Llamas integrated into VSCode?
GPTQ-for-SantaCoder 4bit quantization for SantaCoder
- [Local Llama] Comment exécuter Starcoder-GPTQ-4BIT-128G?
-
How to run starcoder-GPTQ-4bit-128g?
It says use https://github.com/mayank31398/GPTQ-for-SantaCoder to run it, but when I follow those instructions, I always get random errors or it just tries to re-download the original model files.
-
Is it possible to run the 4-bit quantized StarCoder model in Oobabooga?
Is this because Oobabooga only works with 4-bit quantization of LLaMA, OPT, and GPT-J models? I noticed the guy that did the 4-bit quantization points to a pull of GPTQ where they made their own converter? https://github.com/mayank31398/GPTQ-for-SantaCoder
refact
Posts with mentions or reviews of refact.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-15.
- RefactAI: Use best-in-class LLMs for coding in your IDE
-
Supercharge Your Dev Workflow: How Refact's AI-powered Code Completion Boosts Developer Productivity
With over 1.3k stars on GitHub, more than 40k downloads and installs on both VS Code and JetBrains IDEs, and more than 50 positive reviews, it is worth saying that Refact is part of the best product in the AI coding assistant market.
-
What do you use to run your models?
On vscode i sometimes use continue.dev and refact.ai just for fun and they are great!
-
AI Code assistant for about 50-70 users
Refact was made for this: https://github.com/smallcloudai/refact
- Free WebUI for Fine-Tuning and Self-Hosting Open-Source LLMs for Coding
-
LocalPilot: Open-source GitHub Copilot on your MacBook
You should check-out [refact.ai](https://github.com/smallcloudai/refact). It has both autocomplete and chat. It's in active development, with lots of new features coming soon (context search, fine-tuning for larger models, etc)
-
Replit's new AI Model now available on Hugging Face
I don’t recommend that, since that uses the cloud for the actual inference by default (and they provide no guidance for changing that).
I don’t consider cloud inference to count as getting it working “locally” as requested by the comment above yours.
Refact works nicely and works locally, but the challenge with any new model is making it be supported by the existing software: https://github.com/smallcloudai/refact/
- Refact.ai 1.0.0 Released
-
📝 🚀 Creating our first documentation from scratch using Astro and Refact AI coding assistant
Previously, we used Astro for our refact.ai website and wanted to stay within the Astro ecosystem for the documentation.
-
🤖We trained a small 1.6b code model and you can use it as a personal copilot in Refact for free🤖
Refact LLM can be easily integrated into existing developers workflows with an open-source docker container and VS Code and JetBrains plugins. With Refact's intuitive user interface, developers can utilize the model easily for a variety of coding tasks. Finetune is available in the self-hosting (docker) and Enterprise versions, making suggestions more relevant for your private codebase.
What are some alternatives?
When comparing GPTQ-for-SantaCoder and refact you can also consider the following projects:
locai - Connect to Kobold API through VS Code
tabby - Self-hosted AI coding assistant
fauxpilot - FauxPilot - an open-source alternative to GitHub Copilot server
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
llama-cpp-python - Python bindings for llama.cpp
developer - the first library to let you embed a developer agent in your own app!
supervision - We write your reusable computer vision tools. 💜
autodoc - Experimental toolkit for auto-generating codebase documentation using LLMs
nl-wallet - NL Public Reference Wallet
lmdeploy - LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
codellama - Inference code for CodeLlama models