How to create a 1M record table with a single query

• zefaker

  1 29 0.0 JavaScript

  zefaker is a command-line tool for generating CSV, Excel, JSON and SQL files from a Groovy DSL

  

If you need another repeatable way to create random data you can export as SQL INSERTs (or CSV/Excel files) you may find a tool we built and use at work useful: https://github.com/creditdatamw/zefaker

Needs a little Groovy but very convenient for generating random (or non-random) data

• synth

  14 901 8.1 Rust

  Discontinued The Declarative Data Generator

  

This looks convenient (and performant). But how does it scale as queries join across tables?

If you need to create test data with complex business logic, referential integrity and constraints we've been working on declarative data generator that is build exactly for this: https://github.com/openquery-io/synth.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• faker

  9 17,080 9.4 Python

  Faker is a Python package that generates fake data for you. (by joke2k)

Creating realistic fake data is useful in lower environments and for load testing. Outside of SQL I like faker: https://github.com/joke2k/faker

Suggest a related project