🐂 🌾 Oxen.ai - Blazing Fast Unstructured Data Version Control, built in Rust

This page summarizes the projects mentioned and recommended in the original post on /r/rust

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • oxen-release

    Lightning fast data version control system for structured and unstructured machine learning datasets. We aim to make versioning datasets as easy as versioning code.

  • It is, but git-lfs is extremely slow when it comes to these types of use cases. Due to a few factors including the hashing algorithm, and network protocols. I have some bench marking here: https://github.com/Oxen-AI/oxen-release/blob/main/Performance.md

  • dud

    A lightweight CLI tool for versioning data alongside source code and building data pipelines.

  • There is also https://github.com/kevin-hanselman/dud

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • VFSForGit

    Virtual File System for Git: Enable Git at Enterprise Scale

  • Oh dear you're not going to like this.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts