flatterer
jellex
flatterer | jellex | |
---|---|---|
14 | 11 | |
165 | 94 | |
- | - | |
6.6 | 3.8 | |
3 months ago | 6 months ago | |
Rust | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flatterer
-
How to convert a massive JSON into CSV
This tool was built for this purpose https://github.com/kindly/flatterer
-
Show HN: Flatterer Lite, A Rust WASM JSON to tabular converter, for nested data
I have been working on this Rust based JSON flattener (https://github.com/kindly/flatterer) to XLSX/CSV/SQLITE/PARQUET/POSTGRES for about 2 years. I finally made a WASM based one for CSV/XLSX which is really easy to play with. You can use it via a url (if the data has CORS headers), for example https://lite.flatterer.dev?url=https%3A%2F%2Fdummyjson.com%2....
The main difference with other converters/flatteners is that for one-to-many relationships (lists of objects in JSON) it produces a multi table output with keys to help join the tables together. Essentially produces a relational schema, along with some type information, of the JSON provided. For simple non-nested JSON it works too, but is a bit overkill.
Its all opensource and free, and I think that it will become more and more useful as JSON/Graphql APIs proliferate.
-
Create table from JSON
flatterer is the easiest option and will do this for you. It will also load the data into a sqlite or postgres database for you.
-
Robust Rust Library for Converting JSON Objects into CSV Rows
I have also written something similar but higher level flatterer which is python but is a binding to libflatterer. Its main difference is when there is a list of objects it treats it a one to many and creates a separate CSV file.
-
Flatten a massive json file
flatterer (github) is designed for this.
-
Simple GUI tool to query JSON or CSV databases [I have no coding skills]
This looks great and using duckdb as a backend us a great choice. For JSON I suggest using flatterer https://flatterer.opendata.coop/ . Which will convert most JSON into CSV/Parquet with very little technical knowledge.
-
Rust for Data Engineering
My project flatterer (used for flattening JSON into tables) also is mainly a python cli/libarary but is written in Rust for speed/memory efficiency and better concurrency.
-
JSON Processing
I have been working on a similar tool for the last while called flatterer (github). It has a similar aim and works with most kinds of JSON well (but not very well with top level objects like yours).
-
Stream processing - Nested JSON to Parquet
You could try Option B with flatterer https://flatterer.opendata.coop/ which purpose is to convert nested JSON into other formats without a schema upfront including parquet.
-
Turning JSON arrays into tables - Data flattening
flatterer docs (github)
jellex
- Parsing Complex JSON
-
Select, put and delete data from JSON, TOML, YAML, XML and CSV files
You could do something like this in pure python without the json loading boilerplate with jello[0]. An interactive TUI for jello called jellex[1} is also available. (I am the author)
[0] https://github.com/kellyjonbrazil/jello
[1] https://github.com/kellyjonbrazil/jellex
- parsing json help
-
FX: An interactive alternative to jq to process JSON
Also, Jellex is a TUI front-end to Jello that helps with interactively querying the JSON.
- I looking for a TUI liberary/framework with good aesthetics.
- Tips on Adding JSON Output to Your CLI App
- Need help with a JSON response from an API
-
Bringing the Unix Philosophy to the 21st Century
I wrote something similar to this to query JSON and JSON lines with python instead of awk for text. It’s called Jellex (Jello Explorer) which is a TUI front-end to Jello. Jello is a python analog to JQ.
https://github.com/kellyjonbrazil/jellex
-
What's a small Linux program that you don't give much thought but makes your life a hundred times easier from time to time?
There's a new TUI for jello now called jellex that can help you create your jello python filters faster and easier.
-
Fancy console
I made this TUI app using prompt-toolkit
What are some alternatives?
json2csv - command line tool to convert json to csv
jello - CLI tool to filter JSON and JSON Lines data with Python syntax. (Similar to jq)
libflatterer - Lib flatterer: A lib to make JSON flatterer
udiskie - Automounter for removable media
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
py_cui - A python library for intuitively creating CUI/TUI interfaces with widgets, inspired by gocui.
flatten-tool - Tools for generating CSV and other flat versions of the structured data
ijson - Iterative JSON parser with Pythonic interfaces
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
ripgrep - ripgrep recursively searches directories for a regex pattern while respecting your gitignore
json-roller - Command line tool for converting json data structures to tables
httpie - 🥧 HTTPie CLI — modern, user-friendly command-line HTTP client for the API era. JSON support, colors, sessions, downloads, plugins & more.