Partitioning

Open-source projects categorized as Partitioning
Edit details
Language: + Ruby + PLpgSQL + C++ + Erlang + Perl + Go + Python + TypeScript + Batchfile
Topics: Postgresql Sharding Postgres Machine Learning Database
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 10 Partitioning Open-Source Projects

  • pg_partman

    Partition management extension for PostgreSQL

    • Project mention: Dear data engineers | /r/dataengineering | 2023-12-06

    Assuming these are the types of insights you're looking for, you'll probably look for a way to aggregate data points across/within geographies. postgis is an open source extension for postgres that can help you with this, but there's also quite a few python tools that can help you explore the data, such as geopandas, folium, geoplot. Depending on volume, you might want to partition the data for query performance, and there's another extension pg_partman that can help with that. Just noticed some other posts have recommended something similar.

  • pg_party

    ActiveRecord PostgreSQL Partitioning

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • CXXGraph

    Header-Only C++ Library for Graph Representation and Algorithms

    • Project mention: Hacktoberfest is ON CXXGraph | dev.to | 2023-10-09

    Actual Web Site

  • shards

    Partitioned ETS tables for Erlang and Elixir (by cabol)

  • zabbix-mysql-partitioning-perl

    This script is a script written in Perl to partition the Zabbix database tables in time based chunks. We can use this script to replace the Zabbix housekeeper process which tends to get too slow once you hit a certain database size.

  • segmenter

  • scikit-multilearn-ng

    A new maintained "successor" to scikit-multilearn, a scikit-learn based module for multi-label et. al. classification

    • Project mention: I made a follow-up package, scikit-multilearn-ng, to the widely used scikit-multilearn package for multilabel classification | dev.to | 2024-01-29

    So after some developing, I'm here to introduce scikit-multilearn-ng (GitHub: https://github.com/scikit-multilearn-ng/scikit-multilearn-ng), an advanced, open-source tool for multi-label classification in Python. It's a direct successor to scikit-multilearn and brings a host of improvements and new features.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • kafka

    Realtime BTC and ETH Wallet Tracker with Node.js and Kafka (by flolu)

  • PgDice

    Postgres partitioning built on top of https://github.com/ankane/pgslice

  • Install11

    A script that allows you to install Windows 11 by skipping OOBE and other pain

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Partitioning related posts

  • Dear data engineers

    1 project | /r/dataengineering | 6 Dec 2023

  • Pgpartman: Partition Management Extension for Postgres

    1 project | news.ycombinator.com | 20 Sep 2023

  • Zabbix 6.0 and Postgres history_uint table size

    1 project | /r/zabbix | 24 Jan 2023

  • Zabbix meetup online: november 29 2022 by BGmot and Opensource ICT Solutions

    1 project | /r/zabbix | 6 Nov 2022

  • Which is the best way to automate backing up data monthly of tables in a schema and then deleting them?

    1 project | /r/PostgreSQL | 6 Oct 2022

  • Partitioning in Postgres, 2022 Edition

    1 project | news.ycombinator.com | 5 Oct 2022

  • Table partitioning by months of the year?

    1 project | /r/PostgreSQL | 23 Aug 2021
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 6 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Partitioning projects? This list will help you:

Project Stars
1 pg_partman 1,888
2 pg_party 446
3 CXXGraph 396
4 shards 292
5 zabbix-mysql-partitioning-perl 30
6 segmenter 17
7 scikit-multilearn-ng 16
8 kafka 14
9 PgDice 10
10 Install11 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com