The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 7 data-format Open-Source Projects
-
lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
Project mention: Understanding Parquet, Iceberg and Data Lakehouses | news.ycombinator.com | 2023-12-29Parquet has been the lakehouse file format of choice for nearly half a decade. But we are starting to see other contenders that are optimized more for lower latency like lance https://github.com/lancedb/lance
-
Whenever this kind of arguments come up, I am sad that RON (https://github.com/ron-rs/ron) is not better known. To me it feels like a cleaner and better JSON.
In any case, my little experience with it had made me hate YAML. Generally speaking, I have come to dislike any language with significant whitespace other than Haskell.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
-
Project mention: fleece: A super-fast, compact, JSON-equivalent binary data format | /r/programming | 2023-12-06
-
spss-converter
A simple utility that converts SPSS data to / from Pandas DataFrames, CSV, Excel, JSON, YAML, and dict.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
data-format related posts
- fleece: A super-fast, compact, JSON-equivalent binary data format
- Show HN: Lance is a Rust-based alternative to Parquet for ML data
- [Show HN] Lance is a Rust-based alternative to Parquet for ML data
- Ron: Rusty Object Notation
- Ron: Rusty Object Notation
- Ron: Rusty Object Notation
- JSON vs. XML with Douglas Crockford
-
A note from our sponsor - WorkOS
workos.com | 28 Mar 2024
Index
What are some of the best open-source data-format projects? This list will help you:
Project | Stars | |
---|---|---|
1 | lance | 3,164 |
2 | ron | 3,073 |
3 | cson | 1,334 |
4 | chepy | 802 |
5 | lasio | 331 |
6 | fleece | 310 |
7 | spss-converter | 8 |