visual-chatgpt
langchain
| visual-chatgpt | langchain | |
|---|---|---|
| 50 | 152 | |
| 31,684 | 56,526 | |
| - | - | |
| 8.9 | 10.0 | |
| about 1 year ago | 9 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
visual-chatgpt
-
Subtler Flex
For prompting, the GitHub repo I refer to the most is actually one from Microsoft: https://github.com/Microsoft/Visual-ChatGPT
-
OpenDILab Awesome Paper Collection: RL with Human Feedback （1）
Found relevant code at https://github.com/microsoft/visual-chatgpt + all code implementations here
-
[R] Low-code LLM: Visual Programming over LLMs - Yuzhe Cai et al , Microsoft Research Asia 2023
Github: https://github.com/microsoft/visual-chatgpt/tree/main/LowCodeLLM will soon be available!
-
It's been a week and there's already front ends for auto GPT. Is anyone else having a hard time keeping up with the take off? Are we seeing what exponential looks like?
It's not so much the size of the LLMs, it's what people are able to do with them in novel ways, e.g. https://github.com/microsoft/visual-chatgpt/tree/main/TaskMatrix.AI
- Taskmatrix.ai
- Introducing JARVIS : the new Microsoft's autonomous AI powered by HuggingGPT and ChatGPT.
-
How to make ChatGPT run tasks
There is a python library langchain, which microsoft used to give it access to image editing tools. You can write your own tools for it very easily, I've been having fun with it. I gave it internet search tools and it worked great at using current events in the response.
-
An AI researcher who has been warning about the technology for over 20 years says we should 'shut it all down,' and issue an 'indefinite and worldwide' ban.
Something like this: https://github.com/microsoft/visual-chatgpt/tree/main/TaskMatrix.AI could enable a far simpler AI to start making copies of itself.
-
HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends in HuggingFace
Reminds me of VisualChatGPT (https://github.com/microsoft/visual-chatgpt), which also uses a LLM to decide what vision models to run.
-
ChatGPT is Inform8: interactive fiction with dual narration and action planes (both playable), dialogues, inner thoughts and the ability to argue about narration to change the course of action.
The best Microsoft API or overall API? It really depends what your goal is. https://github.com/huggingface is great if you want to dive right in, but https://github.com/microsoft/visual-chatgpt might be good as well (not easy to get to work locally).
langchain
-
🗣️🤖 Ask to your Neo4J knowledge base in NLP & get KPIs
Langchain and the implementation of Custom Tools also is a great (and very efficient) way to setup a dedicated Q&A (for example for chat purpose) agent.
- LangChain – Some quick, high level thoughts on improvements/changes
-
Claude 2 Internal API Client and CLI
We're using it via langchain talking to Amazon Bedrock which is hosting Claude 1.x. It's comparable to GPT3.x, not bad. The integration doesn't seem to be fully there though, I think langchain is expecting "Human:" and "AI:", but Claude uses "Assistant:".
https://github.com/hwchase17/langchain/issues/2638
-
Any better alternatives to fine-tuning GPT-3 yet to create a custom chatbot persona based on provided knowledge for others to use?
Depending on how much work you want to put into it, you can get started at HuggingFace with their models and datasets, but you'd need compute power, multiple MLOps, etc. I was introduced to the concept in this video, since Google has their Vertex AI tools on Google Cloud, and there's always LangChain but I'm not sure about anything recent.
-
langchain VS griptape - a user suggested alternative
2 projects | 11 Jul 20232 projects | 9 Jul 2023
-
Vector storage is coming to Meilisearch to empower search through AI
a documentation chatbot proof of concept using GPT3.5 and LangChain
-
ChatPDF: What ChatGPT Can't Do, This Can!
I encourage everyone to pay attention to the Langchain open-source project and leverage it to achieve tasks that ChatGPT cannot handle.
- LangChain Arbitrary Command Execution - CVE-2023-34541
-
Langchain Is Pointless
Yeah I never know where memory goes exactly in langchain, it's not exactly clear all the time. But sure, the main insight I remember is this, take a look at their MULTI_PROMPT_ROUTER_TEMPLATE: https://github.com/hwchase17/langchain/blob/560c4dfc98287da1...
It's a lot of instructions for an LLM, they seem to forget an LLM is an auto-completion machine, and which data it is trained on. Using <<>> for sections is not a normal thing, it's not markdown, which probably the thing read way more often on the internet, instead of open json comments, why not type signatures, instead of so many rules, why not give it examples? It is an autocomplete machine!
They are relying too much on the LLM being smart because they probably only test stuff in GPT-4 and 3.5, but with GPT4All models this prompt was not working at all, so I had to rewrite it, for simple routing, we don't even need json, carying the `next_inputs` here is weird if you don't need it.
So this is my version of it: https://gist.github.com/rogeriochaves/b67676977eebb1936b9b5c...
It's so basic it's dumb, yet it is more powerful, as it does not rely on GPT-4 level intelligence, it's just what I needed
What are some alternatives?
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
semantic-kernel - Integrate cutting-edge LLM technology quickly and easily into your apps
roomGPT - Upload a photo of your room to generate your dream room with AI.
llama_index - LlamaIndex is a data framework for your LLM applications
JARVIS - JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
llama - Inference code for Llama models
minimal-llama
ControlNet - Let us control diffusion models!
gpt_index - LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data. [Moved to: https://github.com/jerryjliu/llama_index]
pybroker - Algorithmic Trading in Python with Machine Learning
AutoGPT - AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.