We reduced conda’s index fetch bandwidth by 99%

This page summarizes the projects mentioned and recommended in the original post on /r/Python
Archive Tar file-system HTTP chunking

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
WorkOS - The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
featured

  • casync

    Content-Addressable Data Synchronization Tool

    • For arbitrary state changes however, it's better to use something like casync. Note that there are a lot of tunables, implicit and explicit; for package indexing I would particularly think about "how is the index sorted" and "what is the desired chunk size".

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Intro to Content Defined Chunking

    1 project | /r/programming | 16 Mar 2023

  • A Nibble of Content-Defined Chunking - How de-duplicated, incremental file transfer works

    1 project | /r/coding | 16 Oct 2022

  • Casync – A Content-Addressable Data Synchronization Tool

    1 project | /r/patient_hackernews | 23 Apr 2022

  • Casync – A Content-Addressable Data Synchronization Tool

    1 project | /r/hackernews | 23 Apr 2022

  • Hacker News top posts: Apr 23, 2022

    2 projects | /r/hackerdigest | 23 Apr 2022