data-manipulation

Open-source projects categorized as data-manipulation

Top 19 data-manipulation Open-Source Projects

  • CyberChef

    The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

    Project mention: CyberChef VS DevToolboxWeb - a user suggested alternative | libhunt.com/r/CyberChef | 2024-02-06
  • prql

    PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

    Project mention: SQL is syntactic sugar for relational algebra | news.ycombinator.com | 2024-03-23

    > I completely attribute this to SQL being difficult or "backwards" to parse. I mean backwards in the way that in SQL you start with what you want first (the SELECT) rather than what you have and widdling it down.

    > The turning point for me was to just accept SQL for what it is.

    Or just write PRQL and compile it to SQL

    https://github.com/PRQL/prql

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • dplyr

    dplyr: A grammar of data manipulation

    Project mention: Show HN: Open-source, browser-local data exploration using DuckDB-WASM and PRQL | news.ycombinator.com | 2024-03-15

    That's great feedback, thanks!

    This tool definitely comes from a place of personal need - beyond just handling large files, I've also never really gelled well with the Excel/Google Sheet model of changing data in place as if you were editing text. I'm a Data Scientist and always preferred the chained data transforms you see in things like dplyr (https://dplyr.tidyverse.org/) or Polars (https://pola.rs/) and I feel this tool maps very closely to the chained model.

    Also, thank you for the feature requests! Those would all be very useful - we'll put them on the roadmap.

  • danfojs

    Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

  • cyberchef-recipes

    A list of cyber-chef recipes and curated links

  • collapse

    Advanced and Fast Data Transformation in R (by SebKrantz)

  • poorman

    A poor man's dependency free grammar of data manipulation

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • plydata

    A grammar for data manipulation in Python

  • datar

    A Grammar of Data Manipulation in python

  • volbx

    Graphical tool for data manipulation written in C++/Qt.

  • fastverse

    An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R

  • ftools

    Fast Stata commands for large datasets

  • IndexedTables.jl

    Flexible tables with ordered indices

  • brain-brew

    Automated Anki flashcard creation and extraction to/from Csv

    Project mention: Add recommendation for Exporting my cards as a CSV and then importing after making changes? | /r/Anki | 2023-04-07

    I was able to use Brain Brew https://github.com/ohare93/brain-brew/ to import my CSV (eventually). You'll need some programming knowledge (I'm new to Python but I got it working). Basic steps for me was 1) Create a deck in Anki with 1 record; 2) export it in JSON (after installing CrowdAnki); 3) use Brain Brew to convert the JSON to files in a src directory - using the starter repo was helpful https://github.com/ohare93/brain-brew-starter; 4) include the CSV file in the project; 5) use Brain Brew to convert the src files into a deck that can be uploaded (a "build"); 6) use CrowdAnki to import the newly generated build.

  • ctf-party

    :triangular_flag_on_post: A CLI tool & library to enhance and speed up script/exploit writing with string conversion/manipulation.

  • nodium

    Nodium is an easy-to-use data analysis and automation platform using Rust with a visual node-based interface. It includes a plugin browser for downloading extensions, making it versatile for a wide range of data manipulation tasks. No coding experience required.

    Project mention: Nodium. Rust flow-oriented programming language. | /r/rust | 2023-04-23
  • scala-ql

    Data manipulation and reporting for Scala.

  • dot

    Dot: A powerful Go package simplifying navigation and manipulation of complex data structures via dot-separated paths. Features include insertion into struct fields, maps, arrays, slices, and channels, along with robust error handling and support for diverse map keys. (by mowshon)

    Project mention: Introducing Dot: The Magical Path Manipulator for Go! (open source) | /r/golang | 2023-06-28

    🌍 Github: https://github.com/mowshon/dot

  • firebase-admin-cli

    Cli for firebase

    Project mention: Firebase Admin UI | /r/Firebase | 2023-05-18

    A colleague wrote this, I haven't used it though but it might do what you want already https://github.com/siarheidudko/firebase-admin-cli

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-03-23.

data-manipulation related posts

Index

What are some of the best open-source data-manipulation projects? This list will help you:

Project Stars
1 CyberChef 25,017
2 prql 9,362
3 dplyr 4,634
4 danfojs 4,624
5 cyberchef-recipes 1,881
6 collapse 582
7 poorman 327
8 plydata 274
9 datar 255
10 volbx 231
11 fastverse 210
12 ftools 127
13 IndexedTables.jl 117
14 brain-brew 84
15 ctf-party 76
16 nodium 63
17 scala-ql 38
18 dot 18
19 firebase-admin-cli 6
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com