timescaledb-insert-benchmarks

Benchmarking inserting a ~trillion rows of weather data into TimescaleDB (by ali-ramadhan)

Timescaledb-insert-benchmarks Alternatives

Similar projects and alternatives to timescaledb-insert-benchmarks

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better timescaledb-insert-benchmarks alternative or higher similarity.

timescaledb-insert-benchmarks reviews and mentions

Posts with mentions or reviews of timescaledb-insert-benchmarks. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-04-16.
  • Loading a trillion rows of weather data into TimescaleDB
    8 projects | news.ycombinator.com | 16 Apr 2024
    The full dataset is quite huge (~9 petabytes and growing) out of which I'm using just ~8 terabytes. Still quite big to upload.

    The data is freely available from the [Climate Change Service](https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysi...) which has a nice API but download speeds can be a bit slow.

    [NCAR's Research Data Archive](https://rda.ucar.edu/datasets/ds633-0/) provides some of the data (as pre-generated NetCDF files) but at higher download speeds.

    It's not super well documented but I hosted the Python scripts I used to download the data on the accompanying GitHub repository: https://github.com/ali-ramadhan/timescaledb-insert-benchmark...

Stats

Basic timescaledb-insert-benchmarks repo stats
1
12
8.8
30 days ago

ali-ramadhan/timescaledb-insert-benchmarks is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of timescaledb-insert-benchmarks is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com