continue
llama.cpp
| continue | llama.cpp | |
|---|---|---|
| 18 | 777 | |
| 11,309 | 57,984 | |
| 14.7% | - | |
| 10.0 | 10.0 | |
| 3 days ago | about 4 hours ago | |
| TypeScript | C++ | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
continue
-
Ask HN: Who is hiring? (February 2024)
Continue (YC S23) | Founding Engineer | ONSITE | Full-time | San Francisco | $130-$170K + 1-2% Equity
At Continue, we are on a mission to make building software feel like making music. We are creating the open-source autopilot for VS Code and JetBrains——the easiest way to code with any LLM (https://github.com/continuedev/continue).
You are likely a good fit if you
- have founded or want to found your own startup one day
- have experience with frontend, backend, ML technologies
- are enthusiastic about AI/LLMs, open source, developer tools
- get excited about supporting users and helping customers
- want to work in-person in SF the majority of the time
More info: https://www.ycombinator.com/companies/continue/jobs/smcxRnM-...
-
Meta AI releases Code Llama 70B
Continue doesn’t support tab completion like Copilot yet.
A pull/merge request is being worked on: https://github.com/continuedev/continue/pull/758
-
Show HN: Open-source, privacy oriented alternative to GitHub Copilot chat
Good job on the project, but it's unfortunately named. A privy also refers to a latrine.
Given that this project was started well after Continue.dev, I think it would be useful to include an FAQ or a comparison table on what exactly makes this project different.
https://github.com/continuedev/continue
- Continue will generate, refactor, and explain entire sections of code
-
VSC Continue.dev with own Rest API
In this Continue.dev file https://github.com/continuedev/continue/blob/preview/server/continuedev/libs/llm/llamacpp.py the request to llama.cpp is implemented.
- What is your motive for running open-source models, instead of just using a ready-made solution like GPT-4?
-
Ask HN: Who is hiring? (December 2023)
Continue | Founding Engineer | ONSITE | Full-time | San Francisco | $130-$170K + 1-2% Equity
At Continue, we are on a mission to make building software feel like making music. We are creating the open-source autopilot for software development—an IDE extension that brings the power of ChatGPT to VS Code and JetBrains (https://github.com/continuedev/continue).
You are likely a good fit if you
- have founded or want to found your own startup one day
- have experience with frontend, backend, and ML technologies
- are enthusiastic about AI/LLMs, open source, developer tools
- get excited about supporting users and helping customers
- want to work in-person in SF the majority of the time
More info: https://www.ycombinator.com/companies/continue/jobs/smcxRnM-...
-
How helpful are LLMs with MATLAB?
Original source: https://github.com/continuedev/continue/tree/main/docs/docs/languages/matlab.md
-
How are people using open source LLMs in production apps?
We are seeing developers deploy open-source LLMs for their teams to use while coding internally, which each developer then uses with Continue
-
Show HN: Continue – open-source coding autopilot, now in JetBrains
Hi HN!
Since launching Continue two months ago (https://news.ycombinator.com/item?id=36882146), we've received amazing feedback, added features, and greatly improved reliability. But one of the biggest things we heard was the desire for a JetBrains extension. My co-founder Ty and I are super excited to share that we've released an extension for PyCharm, Intellij, WebStorm, and most other JetBrains IDEs - ready for alpha users at https://plugins.jetbrains.com/plugin/22707-continue.
Perhaps the most exciting part is that this effort was kickstarted and in great part developed by a community contributor! If you're curious what it took to make this happen, check out the PR here (https://github.com/continuedev/continue/pull/457). We hope to eventually support every IDE, so we made adding a new extension as easy as implementing a single class. If you're curious why this is possible, you can read more about the Continue Server and the architectural decisions we made here: https://blog.continue.dev/how-we-made-continue-ide-agnostic.
llama.cpp
-
IBM Granite: A Family of Open Foundation Models for Code Intelligence
if you can compile stuff, then looking at llama.cpp (what ollama uses) is also interesting: https://github.com/ggerganov/llama.cpp
the server is here: https://github.com/ggerganov/llama.cpp/tree/master/examples/...
And you can search for any GGUF on huggingface
-
Ask HN: Affordable hardware for running local large language models?
Yes, Metal seems to allow a maximum of 1/2 of the RAM for one process, and 3/4 of the RAM allocated to the GPU overall. There’s a kernel hack to fix it, but that comes with the usual system integrity caveats. https://github.com/ggerganov/llama.cpp/discussions/2182
- Xmake: A modern C/C++ build tool
-
Better and Faster Large Language Models via Multi-Token Prediction
For anyone interested in exploring this, llama.cpp has an example implementation here:
https://github.com/ggerganov/llama.cpp/tree/master/examples/...
- Llama.cpp Bfloat16 Support
-
Fine-tune your first large language model (LLM) with LoRA, llama.cpp, and KitOps in 5 easy steps
Getting started with LLMs can be intimidating. In this tutorial we will show you how to fine-tune a large language model using LoRA, facilitated by tools like llama.cpp and KitOps.
- GGML Flash Attention support merged into llama.cpp
-
Phi-3 Weights Released
well https://github.com/ggerganov/llama.cpp/issues/6849
- Lossless Acceleration of LLM via Adaptive N-Gram Parallel Decoding
- Llama.cpp Working on Support for Llama3
What are some alternatives?
llama-cpp-python - Python bindings for llama.cpp
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
aider - aider is AI pair programming in your terminal
gpt4all - gpt4all: run open-source LLMs anywhere
vscode-flexigpt - FlexiGPT plugin for VSCode. Interact with AI models as a power user
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ChatGPT.nvim - ChatGPT Neovim Plugin: Effortless Natural Language Generation with OpenAI's ChatGPT API
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
prompt - 🥝 A command line application to interact with OpenAI's ChatGPT API.
ggml - Tensor library for machine learning
openvsx - An open-source registry for VS Code extensions
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM