ydata-profiling
OpenRefine
Our great sponsors
ydata-profiling | OpenRefine | |
---|---|---|
43 | 45 | |
11,923 | 10,409 | |
1.5% | 2.6% | |
8.5 | 9.7 | |
8 days ago | 1 day ago | |
Python | Java | |
MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ydata-profiling
- FLaNK 25 December 2023
-
First 15 Open Source Advent projects
6. Ydata-synthetic and Ydata-profiling by YData | Github | tutorial
-
Coding Wonderland: Contribute to YData Profiling and YData Synthetic in this Advent of Code
Send us your North ⭐️: "On the first day of Christmas, my true contributor gave to me..." a star in my GitHub tree! 🎵 If you love these projects too, star ydata-profiling or ydata-synthetic and let your friends know why you love it so much!
-
Simulating sales data
If you're not sure about the behaviour of your data (i.e., if the original data has properties like seasonality), you can use ydata-profiling to profile your data first.
-
I recorded a Data Science Project using Python and uploaded it on Youtube
Super cool! For EDA, you could give ydata-profiling a spin sometime and speed up the process!
-
pandas-profiling VS Rath - a user suggested alternative
2 projects | 12 Jan 2023
-
The Data-Centric AI Community is on Discord 👾
Alternatively, if you found DCAI through pandas-profiling or ydata-synthetic you can find support for your troubleshooting and provide feedback on interesting features!
- [Discussion] - "data sourcing will be more important than model building in the era of foundational model fine-tuning"
- Data profiling as part of a data reliability strategy?
-
GitHub repository with helpful python programs to quickly run through datasets and give a brief summary of it's statistics.
As a learning project, this is nice, but for standard use, what would be the advantage of this over just loading a program into Pandas and calling df.describe()? And if you need more complete details on a data set, using the pandas-profiling package?
OpenRefine
-
Ask HN: What Underrated Open Source Project Deserves More Recognition?
"OpenRefine is a powerful free, open source tool for working with messy data: cleaning it; transforming it from one format into another; and extending it with web services and external data." https://openrefine.org/
-
OpenRefine
It seems to be pure JS with jQuery: https://github.com/OpenRefine/OpenRefine/blob/master/main/we...
-
"We have great datasets"
Open Refine will get you about 70% there. It's FOSS
-
What is the best approach to removing duplicate person records if the only identifier is person firstname middle name and last name? These names are entered in varying ways to the DB, thus they are free-fromatted.
It's not suited to SQL, use Open Refine or python fuzzywuzzy.
-
What are strictly data analysis jobs?
Prior to analysis of the data, the data have to be collected. Especially if those who collect are not (yet) aware that their data collected equally are interesting for an audience different than to the one anticipated, working with data from different source requires data consolidation. This can be fixing typos, cross-validation with other sources about the same topic, etc. There are routines and programs out there to help here (openrefine an example), but relying on them as prêt-a-porter / ready-to-go likely would limit you.
-
Show HN: YoBulk – open-source GPT powered CSV importer[Flatfile.com alternative]
I would suggest https://github.com/OpenRefine/OpenRefine to clean your data.
- Something better than pandas? with interactive graphical UI?
-
(Ab)using a server library as a GUI - bad idea or only sort of bad idea?
OpenRefine does something like this and it works pretty nicely. Overall, it's pretty nice and a simple web server which needs to handle only one connection is very compact, probably smaller than most GUI toolkits. It also takes less overhead and give the user more choice than using WebView which is what Tauri does.
- [Discussion] - "data sourcing will be more important than model building in the era of foundational model fine-tuning"
What are some alternatives?
dtale - Visualizer for pandas data structures
DataProfiler - What's in your data? Extract schema, statistics and entities from datasets
dataframe-go - DataFrames for Go: For statistics, machine-learning, and data manipulation/exploration
CQEngine - Ultra-fast SQL-like queries on Java collections
lux - Automatically visualize your pandas dataframe via a single print! 📊 💡
visidata - A terminal spreadsheet multitool for discovering and arranging data
LightAdmin - [PoC] Pluggable CRUD UI library for Java web applications
get-started-with-JAX - The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series of tutorials (YouTube videos and Jupyter Notebooks) as well as the content I found useful while learning about the JAX ecosystem.
Smooks - Extensible data integration Java framework for building XML and non-XML fragment-based applications
evidently - Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
Jimfs - An in-memory file system for Java 7+
JBake - Java based open source static site/blog generator for developers & designers.