TaskMatrix
llama.cpp
TaskMatrix | llama.cpp | |
---|---|---|
10 | 776 | |
34,519 | 57,463 | |
0.1% | - | |
7.3 | 10.0 | |
4 months ago | 5 days ago | |
Python | C++ | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
TaskMatrix
-
How to create an automation workflow with GPT-4 image input?
I want to create a script that would automatically read telegram posts and process them, for this, using APIs these days is simply not reliable, so I'm thinking of using selenium python with the browser to do this..is there a way to develop an automated workflow that does this? I've looked in visual GPT from Microsoft https://github.com/microsoft/TaskMatrix
- TaskMatrix
- TaskMatrix Connects ChatGPT and a Series of Visual Foundation Models
-
April 2023
Low-code LLM (https://github.com/microsoft/TaskMatrix/tree/main/LowCodeLLM)
-
GPT-4 with browsing prompt
Yep, this is what Microsoft and others have done with the API to create things like bing chat. See: https://github.com/microsoft/TaskMatrix
-
[D] LLM or model that does image -> prompt?
Visual ChatGPT (now renamed as TaskMatrix https://github.com/microsoft/TaskMatrix likely as a result of OpenAI trying to regulate the use of the name GPT. Same happened for GPT-Eval -> G-Eval).
-
What’s stopping ChatGPT from replacing a bunch of jobs right now?
Microsoft is also going to connect millions of APIs. Right now software for the most part lives in silos and needs humans to move information from one software application to another. TaskMatrixAI will automate that by having a standard API schema that everyone buys into like Apple’s iOS if they want to make money. GPT and Jarvis automatically write the Python code to connect any desired APIs. https://github.com/microsoft/TaskMatrix/tree/main/TaskMatrix.AI
- 👨💻 Microsoft Researchers Propose Low-Code LLM: A Novel Human-LLM Interaction Pattern
-
Track-Anything: a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything and XMem.
microsoft/TaskMatrix (github.com)
- The repository where TaskMatrix.AI will be released just officially changed names from Visual ChatGPT to TaskMatrix. Code is probably coming soon.
llama.cpp
-
IBM Granite: A Family of Open Foundation Models for Code Intelligence
if you can compile stuff, then looking at llama.cpp (what ollama uses) is also interesting: https://github.com/ggerganov/llama.cpp
the server is here: https://github.com/ggerganov/llama.cpp/tree/master/examples/...
And you can search for any GGUF on huggingface
-
Ask HN: Affordable hardware for running local large language models?
Yes, Metal seems to allow a maximum of 1/2 of the RAM for one process, and 3/4 of the RAM allocated to the GPU overall. There’s a kernel hack to fix it, but that comes with the usual system integrity caveats. https://github.com/ggerganov/llama.cpp/discussions/2182
- Xmake: A modern C/C++ build tool
-
Better and Faster Large Language Models via Multi-Token Prediction
For anyone interested in exploring this, llama.cpp has an example implementation here:
https://github.com/ggerganov/llama.cpp/tree/master/examples/...
- Llama.cpp Bfloat16 Support
-
Fine-tune your first large language model (LLM) with LoRA, llama.cpp, and KitOps in 5 easy steps
Getting started with LLMs can be intimidating. In this tutorial we will show you how to fine-tune a large language model using LoRA, facilitated by tools like llama.cpp and KitOps.
- GGML Flash Attention support merged into llama.cpp
-
Phi-3 Weights Released
well https://github.com/ggerganov/llama.cpp/issues/6849
- Lossless Acceleration of LLM via Adaptive N-Gram Parallel Decoding
- Llama.cpp Working on Support for Llama3
What are some alternatives?
JARVIS - JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
doctorgpt - DoctorGPT brings GPT into production for application log error diagnosing!
gpt4all - gpt4all: run open-source LLMs anywhere
EditAnything - Edit anything in images powered by segment-anything, ControlNet, StableDiffusion, etc. (ACM MM)
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
E2B - Secure cloud runtime for AI apps & AI agents. Fully open-source.
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
deepdoctection - A Repo For Document AI
ggml - Tensor library for machine learning
supercharger - Supercharge Open-Source AI Models
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM