vimGPT
adept-inference
vimGPT | adept-inference | |
---|---|---|
7 | 3 | |
2,474 | 412 | |
- | 0.5% | |
7.4 | 4.9 | |
20 days ago | 8 months ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vimGPT
- Show HN: Skyvern – open-source browser automation tool
- FLaNK Stack Weekly for 13 November 2023
- vimGPT ist ein experimentelles Tool, dass mit GPT-4 Vision und dem Chrome Plugin Vimium ChatGPT optisch durch das Internet browsen lässt
-
Using GPT-4 Vision with Vimium to browse the web
It's insane that this is now possible:
https://github.com/ishan0102/vimGPT/blob/682b5e539541cd6d710...
> "You need to choose which action to take to help a user do this task: {objective}. Your options are navigate, type, click, and done. Navigate should take you to the specified URL. Type and click take strings where if you want to click on an object, return the string with the yellow character sequence you want to click on, and to type just a string with the message you want to type. For clicks, please only respond with the 1-2 letter sequence in the yellow box, and if there are multiple valid options choose the one you think a user would select. For typing, please return a click to click on the box along with a type with the message to write. When the page seems satisfactory, return done as a key with no value. You must respond in JSON only with no other fluff or bad things will happen. The JSON keys must ONLY be one of navigate, type, or click. Do not return the JSON inside a code block."
adept-inference
- Adept
-
Using GPT-4 Vision with Vimium to browse the web
Ah, very similar to Adept’s[1] concept? Though, their product seems not yet ready.
[1] https://www.adept.ai/
-
Releasing Persimmon-8B
https://github.com/persimmon-ai-labs/adept-inference/issues/...
It’s funny you say production, because all of the errors I ran into suggest the container is expecting your production architecture.
My advice is stream first then make synchronous convenience wrappers on top of that. Also, lean on community standards for PoC. I’m guess your investors are interested in making this scale as cheaply as possible, but that is probably the least important feature for people evaluating your model’s quality locally.
What are some alternatives?
CogVLM - a state-of-the-art-level open visual language model | 多模态预训练模型
OpenAdapt - AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
LLaVA - [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
CoC2023 - Community over Code, Apache NiFi, Apache Kafka, Apache Flink, Python, GTFS, Transit, Open Source, Open Data
BrowserBox - 🌀 Browse the web from a browser you run on a server, rather than on your local device. Lightweight virtual browser. For security, privacy and more! By https://github.com/dosyago
GPT-V-on-Web - 👀🧠 GPT-4 Vision x 💪⌨️ Vimium = Autonomous Web Agent
PyMISP - Python library using the MISP Rest API
vim-agent
FLaNK-Halifax - Community over Code, Apache NiFi, Apache Kafka, Apache Flink, Python, GTFS, Transit, Open Source, Open Data