Personalize-SAM
AgentOoba
| Personalize-SAM | AgentOoba | |
|---|---|---|
| 11 | 10 | |
| 1,437 | 173 | |
| - | - | |
| 7.1 | 7.8 | |
| 9 months ago | 8 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Personalize-SAM
- Weekly Megathread - 14 May 2023
-
This AI Research Proposes PerSAM: A Training-Free Personalization Approach For The Segment Anything Model (SAM)
Code: https://github.com/ZrrSkywalker/Personalize-SAM
- GitHub - ZrrSkywalker/Personalize-SAM: Personalize Segment Anything Model (SAM) with 1 shot in 10 seconds
-
Personalize Segment Anything Model with One Shot
Driven by large-data pre-training, Segment Anything Model (SAM) has been demonstrated as a powerful and promptable framework, revolutionizing the segmentation models. Despite the generality, customizing SAM for specific visual concepts without man-powered prompting is under explored, e.g., automatically segmenting your pet dog in different images. In this paper, we propose a training-free Personalization approach for SAM, termed as PerSAM. Given only a single image with a reference mask, PerSAM first localizes the target concept by a location prior, and segments it within other images or videos via three techniques: target-guided attention, target-semantic prompting, and cascaded post-refinement. In this way, we effectively adapt SAM for private use without any training. To further alleviate the mask ambiguity, we present an efficient one-shot fine-tuning variant, PerSAM-F. Freezing the entire SAM, we introduce two learnable weights for multi-scale masks, only training 2 parameters within 10 seconds for improved performance. To demonstrate our efficacy, we construct a new segmentation dataset, PerSeg, for personalized evaluation, and test our methods on video object segmentation with competitive performance. Besides, our approach can also enhance DreamBooth to personalize Stable Diffusion for text-to-image generation, which discards the background disturbance for better target appearance learning. Code is released at https://github.com/ZrrSkywalker/Personalize-SAM
AgentOoba
-
Could autogpt functionality be implemented?
Something similar was implemented here: https://github.com/flurb18/AgentOoba
- Can someone explain why there isn't a good interface for the oobabooga api in langchain?
-
AgentOoba v0.2 - Custom prompting
Github
- Weekly Megathread - 14 May 2023
- What features would everyone like to see in oog?
-
autogpt-like framework?
Take a look at https://github.com/flurb18/AgentOoba. It's still missing some pieces but it appears they're being worked on..
- An autonomous AI agent extension for Oobabooga's web ui
- AgentOoba v0.1 - better UI, better contextualization, the beginnings of langchain integration and tools
-
Introducing AgentOoba, an extension for Oobabooga's web ui that (sort of) implements an autonomous agent! I was inspired and rewrote the fork that I posted yesterday completely.
Right now, the agent functions as little more than a planner / "task splitter". However I have plans to implement a toolchain, which would be a set of tools that the agent could use to complete tasks. Considering native langchain, but have to look into it. Here's a screenshot and here's a complete sample output. The github link is https://github.com/flurb18/AgentOoba. Installation is very easy, just clone the repo inside the "extensions" folder in your main text-generation-webui folder and run the webui with --extensions AgentOoba. Then load a model and scroll down on the main page to see AgentOoba's input, output and parameters. Enjoy!
What are some alternatives?
PaLM - An open-source implementation of Google's PaLM models
AGiXT - AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
SD-CN-Animation - This script allows to automate video stylization task using StableDiffusion and ControlNet.
EdgeGPT - Extension for Text Generation Webui based on EdgeGPT, a reverse engineered API of Microsoft's Bing Chat AI
SecondShiftAugie - Second Shift Augie is a sassy and sarcastic AI assistant that helps answer questions and summarize YouTube videos. It has several different features, including text-to-speech functionality, and the ability to answer questions about its own code with the !selfreflect command.
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
llama.cpp - LLM inference in C/C++
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
web-llm - Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.
llama_generative_agent - A generative agent implementation for LLaMA based models, derived from langchain's implementation.
threestudio - A unified framework for 3D content generation.
learn-langchain