Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 19 data-manipulation Open-Source Projects
-
CyberChef
The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis
Project mention: CyberChef VS DevToolboxWeb - a user suggested alternative | libhunt.com/r/CyberChef | 2024-02-06 -
prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
> I completely attribute this to SQL being difficult or "backwards" to parse. I mean backwards in the way that in SQL you start with what you want first (the SELECT) rather than what you have and widdling it down.
> The turning point for me was to just accept SQL for what it is.
Or just write PRQL and compile it to SQL
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Project mention: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL | news.ycombinator.com | 2024-03-15
That's great feedback, thanks!
This tool definitely comes from a place of personal need - beyond just handling large files, I've also never really gelled well with the Excel/Google Sheet model of changing data in place as if you were editing text. I'm a Data Scientist and always preferred the chained data transforms you see in things like dplyr (https://dplyr.tidyverse.org/) or Polars (https://pola.rs/) and I feel this tool maps very closely to the chained model.
Also, thank you for the feature requests! Those would all be very useful - we'll put them on the roadmap.
-
danfojs
Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
-
-
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
-
-
fastverse
An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R
-
-
-
Project mention: Add recommendation for Exporting my cards as a CSV and then importing after making changes? | /r/Anki | 2023-04-07
I was able to use Brain Brew https://github.com/ohare93/brain-brew/ to import my CSV (eventually). You'll need some programming knowledge (I'm new to Python but I got it working). Basic steps for me was 1) Create a deck in Anki with 1 record; 2) export it in JSON (after installing CrowdAnki); 3) use Brain Brew to convert the JSON to files in a src directory - using the starter repo was helpful https://github.com/ohare93/brain-brew-starter; 4) include the CSV file in the project; 5) use Brain Brew to convert the src files into a deck that can be uploaded (a "build"); 6) use CrowdAnki to import the newly generated build.
-
ctf-party
:triangular_flag_on_post: A CLI tool & library to enhance and speed up script/exploit writing with string conversion/manipulation.
-
nodium
Nodium is an easy-to-use data analysis and automation platform using Rust with a visual node-based interface. It includes a plugin browser for downloading extensions, making it versatile for a wide range of data manipulation tasks. No coding experience required.
-
-
dot
Dot: A powerful Go package simplifying navigation and manipulation of complex data structures via dot-separated paths. Features include insertion into struct fields, maps, arrays, slices, and channels, along with robust error handling and support for diverse map keys. (by mowshon)
Project mention: Introducing Dot: The Magical Path Manipulator for Go! (open source) | /r/golang | 2023-06-28🌍 Github: https://github.com/mowshon/dot
-
A colleague wrote this, I haven't used it though but it might do what you want already https://github.com/siarheidudko/firebase-admin-cli
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
data-manipulation related posts
- SQL is syntactic sugar for relational algebra
- Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL
-
CyberChef VS DevToolboxWeb - a user suggested alternative
2 projects | 6 Feb 2024
- Shouldn't FROM come before SELECT in SQL?
- PRQL as a DuckDB Extension
- Show HN: File Hider
- UK GCHQ's CyberChef
-
A note from our sponsor - InfluxDB
www.influxdata.com | 28 Mar 2024
Index
What are some of the best open-source data-manipulation projects? This list will help you:
Project | Stars | |
---|---|---|
1 | CyberChef | 25,017 |
2 | prql | 9,362 |
3 | dplyr | 4,634 |
4 | danfojs | 4,624 |
5 | cyberchef-recipes | 1,881 |
6 | collapse | 582 |
7 | poorman | 327 |
8 | plydata | 274 |
9 | datar | 255 |
10 | volbx | 231 |
11 | fastverse | 210 |
12 | ftools | 127 |
13 | IndexedTables.jl | 117 |
14 | brain-brew | 84 |
15 | ctf-party | 76 |
16 | nodium | 63 |
17 | scala-ql | 38 |
18 | dot | 18 |
19 | firebase-admin-cli | 6 |