[P] rclip: Use CLIP to Search for Your Photos in the Command Line

• rclip

  17 646 8.7 Python

  AI-Powered Command-Line Photo Search Tool

Yes, I'm familiar with FAISS and consider using it to speed up the querying. But, I'm sticking with the current solution for now, because it is easier to manage when it comes to updates and removals, and actual querying is not the most time-consuming part of the "querying" execution. Currently, most of the "querying" execution time is being attributed to loading PyTorch and the CLIP model (65-73% when searching through 73 thousand images, even larger percentage on smaller datasets): https://github.com/yurijmikhalevich/rclip/issues/7. I'm interested in addressing this first. I know that TFLite can be fast, so, maybe, it's worth "porting" the model to it.

• faiss

  70 28,054 9.4 C++

  A library for efficient similarity search and clustering of dense vectors.

  

Are you familiar with the FAISS project? Should at least speed up the search piece. For processing, I bet it wouldn't be too hard to make a script that uploads batches of photos to google drive to infer their embeddings via colab.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project