datatable
polars
Our great sponsors
datatable | polars | |
---|---|---|
9 | 144 | |
1,790 | 26,218 | |
0.8% | 6.7% | |
6.1 | 10.0 | |
5 months ago | 1 day ago | |
C++ | Rust | |
Mozilla Public License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datatable
-
Cheat Sheets for data.table to Python's pandas syntax?
Aside from that, there is a Python translation of data.table (see documentation here), which might be worth looking into. However, it hasn't had any major updates in a while: the last release 2 years ago ...
- Any advice on using Pandas as a data analyst?
-
Alternative to Pandas
There's datatable. I haven't used it much, but the R version (data.table) is phenomenal.
-
Need advice on whether to store data set for regression model in SQL database or by using Python modules like Pickle or Parquet
just use HDF5 or Parquet, or CSV + https://github.com/h2oai/datatable to speed up the file reading.
- Massive R analysis of Data Science Language and Job Trends 2022
-
Scikit-Learn Version 1.0
> For me I had with pandas the most issues using it's multiindex.
Yessss. I loathe indices, and have never been in a situation where I was better off with them than without them.
> Regarding fast you have something like Vaex on python sid
I've never used Vaex, but I've used datatable (https://github.com/h2oai/datatable) and polars (https://github.com/pola-rs/polars). Polars is my favorite API, but datatable was faster at reading data (Polars was faster in execution). I'll have to give Vaex a try at some point.
- Show HN: Sheet2dict – simple Python XLSX/CSV reader/to dictionary converter
-
Hey Reddit, here's my comprehensive course on Python Pandas, for free.
Yep. I think this is the downside to a package being entirely maintained by volunteers. In any case, Pandas is still the leading data wrangling package for Python. (I'm excited to see how datatable evolves.)
-
Ditching Excel for Python in a Legacy Industry (Reinsurance)
h2o's data.table clone is fine
https://github.com/h2oai/datatable
polars
-
Why Python's Integer Division Floors (2010)
This is because 0.1 is in actuality the floating point value value 0.1000000000000000055511151231257827021181583404541015625, and thus 1 divided by it is ever so slightly smaller than 10. Nevertheless, fpround(1 / fpround(1 / 10)) = 10 exactly.
I found out about this recently because in Polars I defined a // b for floats to be (a / b).floor(), which does return 10 for this computation. Since Python's correctly-rounded division is rather expensive, I chose to stick to this (more context: https://github.com/pola-rs/polars/issues/14596#issuecomment-...).
-
Polars
https://github.com/pola-rs/polars/releases/tag/py-0.19.0
-
Stuff I Learned during Hanukkah of Data 2023
That turned out to be related to pola-rs/polars#11912, and this linked comment provided a deceptively simple solution - use PARSE_DECLTYPES when creating the connection:
- Polars 0.20 Released
- Segunda linguagem
- Polars: Dataframes powered by a multithreaded query engine, written in Rust
- Summing columns in remote Parquet files using DuckDB
- Polars 0.34 is released. (A query engine focussing on DataFrame front ends)
What are some alternatives?
DataFrame - C++ DataFrame for statistical, Financial, and ML analysis -- in modern C++ using native types and contiguous memory storage
vaex - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
db-benchmark - reproducible benchmark of database-like ops
modin - Modin: Scale your Pandas workflows by changing a single line of code
scientific-visualization-book - An open access book on scientific visualization using python and matplotlib
datafusion - Apache DataFusion SQL Query Engine
sktime - A unified framework for machine learning with time series
DataFrames.jl - In-memory tabular data in Julia
vinum - Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.
Apache Arrow - Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
faiss - A library for efficient similarity search and clustering of dense vectors.