OpenAdapt
adept-inference
OpenAdapt | adept-inference | |
---|---|---|
25 | 3 | |
538 | 412 | |
48.3% | 0.5% | |
9.3 | 4.9 | |
3 days ago | 8 months ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
OpenAdapt
- Rabbit R1 can be run on a Android device
- OpenAdapt: AI-First Process Automation with Large Multimodal Models
- Adapter between LMMs and traditional desktop and web GUI
-
I Witnessed the Future of AI, and It's a Broken Toy
> Rabbit has said the device will be able to learn any app, if you teach it.
We're building this over at https://github.com/OpenAdaptAI/OpenAdapt. OpenAdapt learns to automate tasks in desktop apps by observing human demonstrations.
Early demo: https://twitter.com/abrichr/status/1784307190062342237 (more coming soon!)
The demo is overly simplistic to keep it short -- it also works with arbitrary applications and operations.
Also, we're open source. Contributions and feedback are welcome and encouraged :)
-
Memary is a cutting-edge long-term memory system based on a knowledge graph
Very interesting, thank you for making this available!
At OpenAdapt (https://github.com/OpenAdaptAI/OpenAdapt) we are looking into using pm4py (https://github.com/pm4py) to extract a process graph from a recording of user actions.
I will look into this more closely. In the meantime, could the authors share their perspective on whether Memary could be useful here?
-
Rabbit r1 source code [part 1]
See https://github.com/OpenAdaptAI/OpenAdapt for an alternative that works with desktop GUIs.
-
Survey Study on AI Agents Architectures(2024)
Not mentioned: learning from demonstration. This is the approach we are taking at https://github.com/OpenAdaptAI/OpenAdapt.
- AI-First Process Automation with LLMs/Action/Multimodal/Visual Language Models
-
Show HN: Skyvern – open-source browser automation tool
Congratulations on shipping!
Check out https://github.com/OpenAdaptAI/OpenAdapt for an open source (MIT license) alternative that also works on desktop (including Citrix!)
-
LaVague: Open-source Large Action Model to automate Selenium browsing
https://github.com/mldsai/puterbot is designed for all desktop applications, including browsers. We're also working on a chrome extension to support reading/writing directly to DOM: https://github.com/OpenAdaptAI/OpenAdapt/pull/364
adept-inference
- Adept
-
Using GPT-4 Vision with Vimium to browse the web
Ah, very similar to Adept’s[1] concept? Though, their product seems not yet ready.
[1] https://www.adept.ai/
-
Releasing Persimmon-8B
https://github.com/persimmon-ai-labs/adept-inference/issues/...
It’s funny you say production, because all of the errors I ran into suggest the container is expecting your production architecture.
My advice is stream first then make synchronous convenience wrappers on top of that. Also, lean on community standards for PoC. I’m guess your investors are interested in making this scale as cheaply as possible, but that is probably the least important feature for people evaluating your model’s quality locally.
What are some alternatives?
ios-mail - Secure email that protects your privacy
vimGPT - Browse the web with GPT-4V and Vimium
CogVLM - a state-of-the-art-level open visual language model | 多模态预训练模型
LLaVA - [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
IfcOpenShell - Open source IFC library and geometry engine
GPT-V-on-Web - 👀🧠 GPT-4 Vision x 💪⌨️ Vimium = Autonomous Web Agent
strawberry - A GraphQL library for Python that leverages type annotations 🍓
vim-agent
obsidian-releases - Community plugins list, theme list, and releases of Obsidian.