fastertransformer_backend
refact
| fastertransformer_backend | refact | |
|---|---|---|
| 1 | 34 | |
| 413 | 1,436 | |
| 1.0% | 4.2% | |
| 5.4 | 9.8 | |
| 6 months ago | 2 days ago | |
| Python | JavaScript | |
| BSD 3-clause "New" or "Revised" License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fastertransformer_backend
-
Free alternative to OpenAI Copilot
This is an attempt to build a locally hosted alternative to GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA's Triton Inference Server with the FasterTransformer backend.
refact
- RefactAI: Use best-in-class LLMs for coding in your IDE
-
Supercharge Your Dev Workflow: How Refact's AI-powered Code Completion Boosts Developer Productivity
With over 1.3k stars on GitHub, more than 40k downloads and installs on both VS Code and JetBrains IDEs, and more than 50 positive reviews, it is worth saying that Refact is part of the best product in the AI coding assistant market.
-
What do you use to run your models?
On vscode i sometimes use continue.dev and refact.ai just for fun and they are great!
-
AI Code assistant for about 50-70 users
Refact was made for this: https://github.com/smallcloudai/refact
- Free WebUI for Fine-Tuning and Self-Hosting Open-Source LLMs for Coding
-
LocalPilot: Open-source GitHub Copilot on your MacBook
You should check-out [refact.ai](https://github.com/smallcloudai/refact). It has both autocomplete and chat. It's in active development, with lots of new features coming soon (context search, fine-tuning for larger models, etc)
-
Replit's new AI Model now available on Hugging Face
I don’t recommend that, since that uses the cloud for the actual inference by default (and they provide no guidance for changing that).
I don’t consider cloud inference to count as getting it working “locally” as requested by the comment above yours.
Refact works nicely and works locally, but the challenge with any new model is making it be supported by the existing software: https://github.com/smallcloudai/refact/
- Refact.ai 1.0.0 Released
-
📝 🚀 Creating our first documentation from scratch using Astro and Refact AI coding assistant
Previously, we used Astro for our refact.ai website and wanted to stay within the Astro ecosystem for the documentation.
-
🤖We trained a small 1.6b code model and you can use it as a personal copilot in Refact for free🤖
Refact LLM can be easily integrated into existing developers workflows with an open-source docker container and VS Code and JetBrains plugins. With Refact's intuitive user interface, developers can utilize the model easily for a variety of coding tasks. Finetune is available in the self-hosting (docker) and Enterprise versions, making suggestions more relevant for your private codebase.
What are some alternatives?
CodeGen - CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
tabby - Self-hosted AI coding assistant
fauxpilot - FauxPilot - an open-source alternative to GitHub Copilot server
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
llama-cpp-python - Python bindings for llama.cpp
developer - the first library to let you embed a developer agent in your own app!
supervision - We write your reusable computer vision tools. 💜
autodoc - Experimental toolkit for auto-generating codebase documentation using LLMs
locai - Connect to Kobold API through VS Code
nl-wallet - NL Public Reference Wallet
lmdeploy - LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
codellama - Inference code for CodeLlama models