condenser
multi-table
| condenser | multi-table | |
|---|---|---|
| 14 | 1 | |
| 299 | 7 | |
| 1.3% | - | |
| 1.7 | 10.0 | |
| 5 months ago | over 1 year ago | |
| Python | Jupyter Notebook | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
condenser
-
Jailer, a unique open-source database tool
[1]: https://github.com/TonicAI/condenser
-
Ask HN: What are the open source tools for database subsetting?
[1]: https://github.com/TonicAI/condenser
-
Recommendation for tool or script for sanitizing data
This may be overkill but we have used Tonic for this: https://www.tonic.ai/
-
Is it atypical to have a dev DB service on your local environment?
A tool like https://www.tonic.ai/ might help.
- Launch HN: JumpWire (YC W22) – Easily encrypt customer data in your databases
-
Anonymize test data?
I attended a presentation a month or so ago where a co-worker was advocating for tonic. I've never used it myself, but, definitely looks as though it would cover your bases. I do agree with onomazein though that this should really be handled on the infrastructure side if at all possible. Dev's, testers, anyone else should be able to pull from an already anonymized location, but, but, someone else should be responsible for setting up the environment and the initial synchronization.
-
What's the coolest automation tool you've built or been involved in?
So I built a gitlab pipeline to create a backup of this upstream db without downtime using various SQL utils. This archive is then staged into an image so the data will unpack and load on startup. I then used a data subsetter called condenser to create datasets for certain use cases. Now devs can load reliable dev data quicker, test against data that QA uses but within their unique envs (local and preview) and create datasets for their own use cases.
- Preserve the unique relationships between data columns while wiping sensitive information from those columns using randomization.
- Don't let your test data suffer - meet the Tonic and Google BigQuery partnership.
- Don't let your test data suffer - meet the Tonic.ai and Amazon Redshift partnership for Real. Fake. Data.
multi-table
-
Generate Synthetic Data in 3 Lines of Code
We have some preliminary work in this direction https://github.com/gretelai/multi-table
I love the idea of "table space" though. It would be fun to traverse this space and output a new database at each step, like a VAE.
What are some alternatives?
Replibyte - Seed your development database with real data ⚡️
boxball - Prebuilt Docker images with Retrosheet's complete baseball history data for many analytical frameworks. Includes Postgres, cstore_fdw, MySQL, SQLite, Clickhouse, Drill, Parquet, and CSV.
prisma-field-encryption - Transparent field-level encryption at rest for Prisma
wordscapes-bot - A Bot that Completes Levels on the Videogame WordScapes
sitcom-simulator-cli - A tool that combines GPT-3, Stable Diffusion, and FakeYou to create fully automated video. [Moved to: https://github.com/joshmoody24/sitcom-simulator]
infrastructure-tools - JumpWire deployment and installation scripts
Docker Compose - Define and run multi-container applications with Docker
afum - audio file upload manager gui for tttweb
Jailer - Database Subsetting and Relational Data Browsing Tool.
acra - Database security suite. Database proxy with field-level encryption, search through encrypted data, SQL injections prevention, intrusion detection, honeypots. Supports client-side and proxy-side ("transparent") encryption. SQL, NoSQL.
profiles
pgcli - Postgres CLI with autocompletion and syntax highlighting