bellboy
timescaledb-parallel-copy
bellboy | timescaledb-parallel-copy | |
---|---|---|
3 | 2 | |
93 | 349 | |
- | 1.1% | |
6.3 | 5.6 | |
11 days ago | 6 days ago | |
TypeScript | Go | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bellboy
-
PostgreSQL alternative for Large amounts of data
If you are doing processing on each row, I would suggest that take a look at this library https://github.com/Claviz/bellboy Itβs leveraging node js streams and provides quite a few essentials required for such etl processing.
- excel file to sql with relationship?
-
Delightful data parsing. First open-source project! Looking for feedback
Similar lib which efficiently parses/streams/transforms data from different sources https://github.com/Claviz/bellboy
timescaledb-parallel-copy
-
PostgreSQL alternative for Large amounts of data
As @dcalde mentioned before, apart from the timescaledb extension, there is parallel-copy (https://github.com/timescale/timescaledb-parallel-copy) which uses multiple threads / connections to bulk insert CSV files into postgresql. It works with timescale's hypertables, but also vanilla postgres tables.
What are some alternatives?
xlstream - Turns XLSX into a readable stream.
q - q - Run SQL directly on delimited files and multi-file sqlite databases
cpsfy - π Tiny goodies for Continuation-Passing-Style functions, fully tested
datafusion - Apache DataFusion SQL Query Engine
OF - π¬ Promise wrapper with sugar π¬
pgloader - Migrate to PostgreSQL in a single command!
Node RED - Low-code programming for event-driven applications
rows - A common, beautiful interface to tabular data, no matter the format
matchbook-ts - pattern matching in javascript & typescript made easy
etlp - A transducers based etl processing library written in clojure
iterum - Handling iterables like lazy arrays.
promise-breaker - Helps you write libraries that accept both promises and callbacks.