datacompy
visions
| datacompy | visions | |
|---|---|---|
| 4 | 6 | |
| 386 | 199 | |
| 8.8% | 2.5% | |
| 7.5 | 6.0 | |
| 5 days ago | 9 days ago | |
| Python | Python | |
| Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datacompy
- How to Check 2 SQL Tables Are the Same
-
Comparing 2 CSV files
datacompy is a package to compare 2 pandas dataframes
- Performing Data Tests on External Data/Complex Data Quality Checks
-
Best Practice When Comparing Data Across Two SQL Servers in Python
https://github.com/capitalone/datacompy will allow you to compare two tables/dataframes against one another, and see detailed results on the difference.
visions
-
Complete Beginner tasked with ML at work - where do I start
This one works pretty well: https://github.com/dylan-profiler/visions
- Visions – User defined data type systems
- Show HN: Visions – User defined data type systems
-
Show HN: DataProfiler – What's in your data? Extract schema, stats and entities
This is really cool! I'm glad there's more work going into the area - visions[1] is a similar tool which embeds the type system (user defined schema) into a traversable graph rather than encoding all type information in the trained network. We originally wrote it as the backend for pandas-profiling[2].
I'm not sure if any of the authors are on here but y'all might look into Sherlock[3] as well. They've got pre-trained models for many other semantic types than you've currently implemented.
1. https://github.com/dylan-profiler/visions
What are some alternatives?
koalas - Koalas: pandas API on Apache Spark
ydata-profiling - 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
data-science-ipython-notebooks - Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
DataProfiler - What's in your data? Extract schema, statistics and entities from datasets
data-diff - Compare tables within or across databases
superset - Apache Superset is a Data Visualization and Data Exploration Platform
dbt-audit-helper - Useful macros when performing data audits
scikit-learn - scikit-learn: machine learning in Python
visualiza - A general-purpose dynamic data visualizer.
Apache Superset - Apache Superset is a Data Visualization and Data Exploration Platform [Moved to: https://github.com/apache/superset]
popmon - Monitor the stability of a Pandas or Spark dataframe ⚙︎
calculadora-do-cidadao - 💵 Tool for Brazilian Reais monetary adjustment/correction