timescaledb-insert-benchmarks
proton
| timescaledb-insert-benchmarks | proton | |
|---|---|---|
| 1 | 10 | |
| 14 | 1,327 | |
| - | 6.3% | |
| 8.8 | 9.7 | |
| about 2 months ago | 4 days ago | |
| Python | C++ | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
timescaledb-insert-benchmarks
-
Loading a trillion rows of weather data into TimescaleDB
The full dataset is quite huge (~9 petabytes and growing) out of which I'm using just ~8 terabytes. Still quite big to upload.
The data is freely available from the [Climate Change Service](https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysi...) which has a nice API but download speeds can be a bit slow.
[NCAR's Research Data Archive](https://rda.ucar.edu/datasets/ds633-0/) provides some of the data (as pre-generated NetCDF files) but at higher download speeds.
It's not super well documented but I hosted the Python scripts I used to download the data on the accompanying GitHub repository: https://github.com/ali-ramadhan/timescaledb-insert-benchmark...
proton
- FLaNK-AIM Weekly 06 May 2024
-
Loading a trillion rows of weather data into TimescaleDB
What's the process for adding support for other databases to your tool qStudio?
I'm thinking perhaps you could add support for Timeplus [1]? Timeplus is a streaming-first database built on ClickHouse. The core DB engine Timeplus Proton is open source [2].
It seems that qStudio is open source [3] and written in Java and will need a JDBC driver to add support for a new RDBMS? If yes, Timeplus Proton has an open source JDBC driver [4] based on ClickHouse's driver but with modifications added for streaming use cases.
1: https://www.timeplus.com/
2: https://github.com/timeplus-io/proton
3: https://github.com/timeseries/qstudio
4: https://github.com/timeplus-io/proton-java-driver
-
Comparing Timeplus Proton and ksqlDB for stream processing
* Proton is more developer friendly
To explore Proton yourself, visit the [Proton GitHub repo](https://github.com/timeplus-io/proton) or create your own workspace on [Timeplus Cloud](https://timeplus.com).
- FLaNK Stack Weekly 19 Feb 2024
- Proton, a fast and lightweight alternative to Apache Flink
- Proton, extending the historical data, storage, and computing of ClickHouse
- Proton, a unified database for streaming and historical data in a single binary
-
First 15 Open Source Advent projects
5. Proton by Timeplus | Github | tutorial
- Timeplus has open-sourced its core streaming processing engine Proton
What are some alternatives?
ytsaurus - YTsaurus is a scalable and fault-tolerant open-source big data platform.
proton-python-driver - Python driver for Proton which support Proton native wire protocol
OSQuery - SQL powered operating system instrumentation, monitoring, and analytics.
duckdb - DuckDB is an in-process SQL OLAP Database Management System
POCO - The POCO C++ Libraries are powerful cross-platform C++ libraries for building network- and internet-based applications that run on desktop, server, mobile, IoT, and embedded systems.
ClickHouse - ClickHouse® is a free analytics DBMS for big data
clickhouse_fdw - ClickHouse FDW for PostgreSQL
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
Milvus - A cloud-native vector database, storage for next generation AI applications
kubeadmiral - Multi-Cluster Kubernetes Orchestration
openvino-plugins-ai-audacity - A set of AI-enabled effects, generators, and analyzers for Audacity®.
flyte - Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.