indexify
big_vision
| indexify | big_vision | |
|---|---|---|
| 4 | 5 | |
| 250 | 1,582 | |
| 32.0% | 5.8% | |
| 9.9 | 7.1 | |
| 7 days ago | about 1 month ago | |
| Rust | Jupyter Notebook | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
indexify
-
How I got my first Rust job by doing open-source
Around 2 weeks ago now, someone opened an issue on OasysDB to integrate it to his platform, Indexify, an open-source platform to extract and process various unstructured data from different sources for generative AI apps in real-time.
-
I accidentally built a meme search engine
These hacks/side projects are amazing! I feel we will see a lot of creativity as tools to build data intensive AI applications become easier.
We built and open sourced Indexify https://github.com/tensorlakeai/indexify to make it easy to build resilient pipelines to combine data with many different models and transformations to build applications that relies on embedding or any other metadata extracted by models from Videos, Photos and any documents!
I didn’t know about SigClip, the author mentioned on the blog, need to add this to our library :) I also found it incredible that he generated the crawler with Claude! This is the type of boilerplate I hope we don’t have to write in the future
- Indexify -Scalable, realtime, continuous indexing engine–Unstructured Data to AI
-
Job: Rust + Retrieval Systems at Etsy
OP I sent you a message, not sure if you have seen it! I am working on an open source project in the retrieval space - https://github.com/diptanu/indexify I would love to chat more with you guys and hear what you are doing :)
big_vision
-
I accidentally built a meme search engine
I think this is based off Google research https://github.com/google-research/big_vision
-
Show HN: I made a Pinterest clone using SigLIP image embeddings
The the vision training models are available here: https://github.com/google-research/big_vision/tree/main which I am assuming, based on the research paper is what was used for the project.
-
[D] What are the strongest plain baselines for Vision Transformers on ImageNet?
Found relevant code at https://github.com/google-research/big_vision + all code implementations here
-
[P] Simple ViT Implementation in Flax
Official Github repository: https://github.com/google-research/big_vision
-
Open-Source Simple-ViT Implementation
An open-source implementation of the Better plain ViT baselines for ImageNet-1k research paper in Google's JAX and Flax.
An update from some of the same authors of the original paper proposes simplifications to ViT that allows it to train faster and better.
Among these simplifications include 2d sinusoidal positional embedding, global average pooling (no CLS token), no dropout, batch sizes of 1024 rather than 4096, and use of RandAugment and MixUp augmentations. They also show that a simple linear at the end is not significantly worse than the original MLP head.
Simple ViT Research Paper: https://arxiv.org/abs/2205.01580
Official Github repository: https://github.com/google-research/big_vision
Developer updates can be found on: https://twitter.com/EnricoShippole
In collaboration with Dr. Phil 'Lucid' Wang: https://github.com/lucidrains
What are some alternatives?
floneum - A toolkit for controllable, private AI on consumer hardware in rust
text-embeddings-inference - A blazing fast inference solution for text embeddings models
searchGPT - Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.
burn - Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.
Queryable - Run OpenAI's CLIP model on iOS to search photos.
smartgpt - A program that provides LLMs with the ability to complete complex tasks using plugins.
hash - 🚀 The open-source, self-building database. From @hashintel