Indexing iCloud Photos with AI Using LLaVA and Pgvector

• hachi

  6 140 9.6 Python

  An end to end semantic and meta-data search engine for personal data.

I think image-encoder from CLIP (even smallest variant ViT B/32) is good enough to capture a lot of semantic information to allow natural language query once images are indexed. A lot of work actually goes into integrating with existing meta-data like local-directory, date-time to augment NL query and re-ranking the results.

I work on such a tool[0] to enable end to end indexing of user's personal photos and recently added functionality to index Google Photos too!

[0] https://github.com/eagledot/hachi

• insightface

  34 21,230 7.7 Python

  State-of-the-art 2D and 3D Face Analysis Project

  

I haven't used it for search, but I believe Insightface's embeddings can be used for this purpose. https://insightface.ai/

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project