condenser
Replibyte
| condenser | Replibyte | |
|---|---|---|
| 14 | 43 | |
| 299 | 3,995 | |
| 1.3% | 0.6% | |
| 1.7 | 2.5 | |
| 5 months ago | 4 months ago | |
| Python | Rust | |
| MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
condenser
-
Jailer, a unique open-source database tool
[1]: https://github.com/TonicAI/condenser
-
Ask HN: What are the open source tools for database subsetting?
[1]: https://github.com/TonicAI/condenser
-
Recommendation for tool or script for sanitizing data
This may be overkill but we have used Tonic for this: https://www.tonic.ai/
-
Is it atypical to have a dev DB service on your local environment?
A tool like https://www.tonic.ai/ might help.
- Launch HN: JumpWire (YC W22) – Easily encrypt customer data in your databases
-
Anonymize test data?
I attended a presentation a month or so ago where a co-worker was advocating for tonic. I've never used it myself, but, definitely looks as though it would cover your bases. I do agree with onomazein though that this should really be handled on the infrastructure side if at all possible. Dev's, testers, anyone else should be able to pull from an already anonymized location, but, but, someone else should be responsible for setting up the environment and the initial synchronization.
-
What's the coolest automation tool you've built or been involved in?
So I built a gitlab pipeline to create a backup of this upstream db without downtime using various SQL utils. This archive is then staged into an image so the data will unpack and load on startup. I then used a data subsetter called condenser to create datasets for certain use cases. Now devs can load reliable dev data quicker, test against data that QA uses but within their unique envs (local and preview) and create datasets for their own use cases.
- Preserve the unique relationships between data columns while wiping sensitive information from those columns using randomization.
- Don't let your test data suffer - meet the Tonic and Google BigQuery partnership.
- Don't let your test data suffer - meet the Tonic.ai and Amazon Redshift partnership for Real. Fake. Data.
Replibyte
-
Ask HN: What's your favorite rust binaries?
I like rust binaries because they are cross-platform. I've found cool ones like
- https://github.com/static-web-server/static-web-server/
- https://github.com/Qovery/Replibyte
If you know any repos where I may find compilation of tools I'll be thankful!
-
Do you use Preview Environments?
Maybe [Replibyte](https://github.com/Qovery/replibyte) - an open-source tool to seed your database with real data can be useful
-
Restricting rails console access for sensitive field
Recently came across this: https://github.com/Qovery/Replibyte could be a nice solution if applied to this workflow.
- Replibyte - Seed Your Development Database With Real Data [Written in Rust]
- Replibyte - 用真实的数据作为你的数据库的种子 (Replibyte – Seed your database with real data)
- Replibyte – Seed your database with real data
- An open-source tool to seed your dev database with real data
What are some alternatives?
boxball - Prebuilt Docker images with Retrosheet's complete baseball history data for many analytical frameworks. Includes Postgres, cstore_fdw, MySQL, SQLite, Clickhouse, Drill, Parquet, and CSV.
Jailer - Database Subsetting and Relational Data Browsing Tool.
prisma-field-encryption - Transparent field-level encryption at rest for Prisma
awesome-db-tools - Everything that makes working with databases easier
wordscapes-bot - A Bot that Completes Levels on the Videogame WordScapes
copycat - Generate deterministic fake values: The same input will always generate the same fake-output.
sitcom-simulator-cli - A tool that combines GPT-3, Stable Diffusion, and FakeYou to create fully automated video. [Moved to: https://github.com/joshmoody24/sitcom-simulator]
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
infrastructure-tools - JumpWire deployment and installation scripts
aws-vault - A vault for securely storing and accessing AWS credentials in development environments
Docker Compose - Define and run multi-container applications with Docker
engine - The Orchestration Engine To Deliver Self-Service Infrastructure Faster ⚡️