starcoder
serge
starcoder | serge | |
---|---|---|
10 | 40 | |
7,125 | 5,563 | |
1.0% | 1.1% | |
6.6 | 9.8 | |
3 months ago | 3 days ago | |
Python | Svelte | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
starcoder
- StarCoder: A language model trained on source code and natural language text
-
openai i screwing themselves hard.
Use local LLM like: https://github.com/bigcode-project/starcoder
-
Guanaco 7B, 13B, 33B and 65B models by Tim Dettmers: now for your local LLM pleasure
Here's the script I use to merge a LoRA onto a base model: https://gist.github.com/TheBloke/d31d289d3198c24e0ca68aaf37a19032 (a slightly modified version of https://github.com/bigcode-project/starcoder/blob/main/finetune/merge_peft_adapters.py)
-
Starhugger.el now displays suggestions as overlays
consult: https://github.com/bigcode-project/starcoder/issues/6 https://huggingface.co/bigcode/starcoder/discussions/12
- FLaNK Stack for 15 May 2023
-
GPT-4 Week 7. Government oversight, Strikes, Education, Layoffs & Big tech are moving - Nofil's Weekly Breakdown
StarCoder - The biggest open source code LLM. It’s a free VS code extension. Looks great for coding, makes you wonder how long things like Github Copilot and Ghostwriter can afford to charge when we have open source building things like this. Link to github [Link] Link to HF [Link]
-
Model For Just Coding
Outside of just using GPT4, which works well, this is supposedly the solution, though I haven't tried it just yet. starcoder/README.md at main · bigcode-project/starcoder · GitHub
- BigCode Project Releases StarCoder: A 15B Code LLM
-
StarCoder 15b open-source code model beats Codex and Replit
GitHub link: https://github.com/bigcode-project/starcoder/tree/main
- StarCoder
serge
- Show HN: I made an app to use local AI as daily driver
- chatgpt alternative
-
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2
Very cool, this looks like a combination of chatbot-ui and llama-cpp-python? A similar project I've been using is https://github.com/serge-chat/serge. Nous-Hermes-Llama2-13b is my daily driver and scores high on coding evaluations (https://huggingface.co/spaces/mike-ravkine/can-ai-code-resul...).
-
LeCun: Qualcomm working with Meta to run Llama-2 on mobile devices
You might be pleased to hear that nothing really stops you from doing this today. If you ran Serge[0] on a Mac with Tailscale, you could hack together a decently-accelerated Llama chatbot.
[0] https://github.com/serge-chat/serge
-
Chatbot frontend library in Svelte?
Cannot help you with libraries specifically but both Serge and ChatUI are built using SvelteKit, so the code might be of some use to you.
- We’re back and…
-
Best way to use AMD CPU and GPU
Serge made it really easy for me to get started, but it all CPU-based.
-
Need Help
All that said this project probably solves your problem: https://github.com/serge-chat/serge
- Are you selfhosting a ChatGPT alternative?
-
What the hell??
You can play a little bit with more straightforward local models (the simplest to setup is https://github.com/nsarrazin/serge ), to see that any LLM is basically a party trick.
What are some alternatives?
langflow - ⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.
gpt4all - gpt4all: run open-source LLMs anywhere
SillyTavern - LLM Frontend for Power Users.
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]
llama.cpp - LLM inference in C/C++
openvino_notebooks - 📚 Jupyter notebook tutorials for OpenVINO™
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
GPTQ-for-LLaMa - 4 bits quantization of LLaMa using GPTQ
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Rath - Next generation of automated data exploratory analysis and visualization platform.
llama-gpt - A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!