starcoder.cpp
refact
starcoder.cpp | refact | |
---|---|---|
3 | 34 | |
437 | 1,436 | |
1.6% | 4.2% | |
4.8 | 9.8 | |
9 months ago | 7 days ago | |
C | JavaScript | |
- | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
starcoder.cpp
-
I use chatGPT for hours everyday and can say 100% it's been nerfed over the last month or so. As an example it can't solve the same types of css problems that it could before. Imagine if you were talking to someone everyday and their iq suddenly dropped 20%, you'd notice. People are noticing.
Then, you'll need Starcoder cpp (NOT LLaMA cpp)
-
What coding llm is the best?
I'm talking about https://github.com/bigcode-project/starcoder.cpp/tree/main specifically. It is just a command line utility which is why I was wondering if anyone knows of a better way of running it.
-
Is there such a thing as local Llamas integrated into VSCode?
starcoder.cpp
refact
- RefactAI: Use best-in-class LLMs for coding in your IDE
-
Supercharge Your Dev Workflow: How Refact's AI-powered Code Completion Boosts Developer Productivity
With over 1.3k stars on GitHub, more than 40k downloads and installs on both VS Code and JetBrains IDEs, and more than 50 positive reviews, it is worth saying that Refact is part of the best product in the AI coding assistant market.
-
What do you use to run your models?
On vscode i sometimes use continue.dev and refact.ai just for fun and they are great!
-
AI Code assistant for about 50-70 users
Refact was made for this: https://github.com/smallcloudai/refact
- Free WebUI for Fine-Tuning and Self-Hosting Open-Source LLMs for Coding
-
LocalPilot: Open-source GitHub Copilot on your MacBook
You should check-out [refact.ai](https://github.com/smallcloudai/refact). It has both autocomplete and chat. It's in active development, with lots of new features coming soon (context search, fine-tuning for larger models, etc)
-
Replit's new AI Model now available on Hugging Face
I don’t recommend that, since that uses the cloud for the actual inference by default (and they provide no guidance for changing that).
I don’t consider cloud inference to count as getting it working “locally” as requested by the comment above yours.
Refact works nicely and works locally, but the challenge with any new model is making it be supported by the existing software: https://github.com/smallcloudai/refact/
- Refact.ai 1.0.0 Released
-
📝 🚀 Creating our first documentation from scratch using Astro and Refact AI coding assistant
Previously, we used Astro for our refact.ai website and wanted to stay within the Astro ecosystem for the documentation.
-
🤖We trained a small 1.6b code model and you can use it as a personal copilot in Refact for free🤖
Refact LLM can be easily integrated into existing developers workflows with an open-source docker container and VS Code and JetBrains plugins. With Refact's intuitive user interface, developers can utilize the model easily for a variety of coding tasks. Finetune is available in the self-hosting (docker) and Enterprise versions, making suggestions more relevant for your private codebase.
What are some alternatives?
autodoc - Experimental toolkit for auto-generating codebase documentation using LLMs
tabby - Self-hosted AI coding assistant
locai - Connect to Kobold API through VS Code
fauxpilot - FauxPilot - an open-source alternative to GitHub Copilot server
chat-with-gpt - An open-source ChatGPT app with a voice
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
LibreChat - Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development
llama-cpp-python - Python bindings for llama.cpp
developer - the first library to let you embed a developer agent in your own app!
oasis - Local LLaMAs/Models in VSCode
supervision - We write your reusable computer vision tools. đź’ś