Top 11 pydata Open-Source Projects

• Dask

  32 11,982 9.7 Python

  Parallel computing with task scheduling

  

Project mention: The Distributed Tensor Algebra Compiler (2022) | news.ycombinator.com | 2023-06-15

• cudf

  23 7,257 9.9 C++

  cuDF - GPU DataFrame Library

  

Project mention: A Polars exploration into Kedro | dev.to | 2023-05-17

The interesting thing about Polars is that it does not try to be a drop-in replacement to pandas, like Dask, cuDF, or Modin, and instead has its own expressive API. Despite being a young project, it quickly got popular thanks to its easy installation process and its “lightning fast” performance.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• koalas

  2 3,317 4.6 Python

  Koalas: pandas API on Apache Spark

  

• stumpy

  6 2,984 7.9 Python

  STUMPY is a powerful and scalable Python library for modern time series analysis

  

Project mention: Stumpy: Matrix profile time series analysis | news.ycombinator.com | 2024-03-03

• pandas-datareader

  3 2,812 6.3 Python

  Extract data from a wide range of Internet sources into a pandas DataFrame.

  

Project mention: Seeking recommendations for forex economic data API | /r/algotrading | 2023-05-03

I've looked at https://github.com/pydata/pandas-datareader and it looks good, does anyone have experience?

• distributed

  3 1,540 9.6 Python

  A distributed task scheduler for Dask

  

• pyjanitor

  4 1,277 8.2 Python

  Clean APIs for data cleaning. Python implementation of R package Janitor

  

Project mention: Sub library with useful code | /r/learnpython | 2023-05-19

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• pyvtreat

  1 114 6.9 Python

  vtreat is a data frame processor/conditioner that prepares real-world data for predictive modeling in a statistically sound manner. Distributed under a BSD-3-Clause license.

  

• python-graphblas

  4 112 8.0 Jupyter Notebook

  Python library for GraphBLAS: high-performance sparse linear algebra for scalable graph analytics

  

• graphblas-algorithms

  3 60 6.2 Python

  Graph algorithms written in GraphBLAS

  

• sgkit

  1 0 8.0 HTML

  We've moved to https://github.com/sgkit-dev/sgkit

  

pydata related posts

• Shuffling large data at constant memory in Dask
  1 project | /r/Python | 17 Apr 2023
• My new company uses Pyspark. I want to learn it before my starting date. Any advice?
  1 project | /r/datascience | 10 Nov 2022
• Great forward progress on squashing cluster deadlocks
  1 project | /r/dask | 15 Dec 2021
• Is Numpy always more efficient than Pandas? And how much should we rely on Python anyway?
  1 project | /r/datascience | 10 Dec 2021
• Ask HN: Is PySPark a Dead-End?
  1 project | news.ycombinator.com | 5 Dec 2021
• How to load 85.6 GB of XML data into a dataframe
  1 project | /r/pythontips | 1 Dec 2021
• How to load 85.6 GB of XML data into a dataframe
  1 project | /r/learnprogramming | 1 Dec 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 19 Apr 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com