pg_bulkload
PipelineDB
| pg_bulkload | PipelineDB | |
|---|---|---|
| 4 | 3 | |
| 403 | 2,603 | |
| 2.7% | 0.0% | |
| 4.6 | 0.0 | |
| 2 months ago | about 2 years ago | |
| C | C | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pg_bulkload
-
Ingesting multiple large .sql files into Postgres database
Did you look at tools like https://github.com/ossc-db/pg_bulkload ?
-
SQLalchemy, postgres, and parallelizing
TLDR I would restrict the use of Python to the data processing and use a dedicated solution for loading the data into Postgres, such as the native COPY on a table without keys/indexes, or pg_bulkload.
- How to import csv to postgresql in a faster way ?
-
MEET A STEERING COMMITTEE MEMBER: TORU SHIMOGAKI OF NTT DATA
Tell us about your career path, interest in green software and your journey to the Green Software Foundation (GSF) As a software engineer, I initially worked on performance improvements and feature additions for PostgreSQL, an open-source software - RDBMS. I am the original developer of a data loading utility called pg_bulkload. After that, I supported the introduction of Apache Hadoop, Apache Spark, and Apache Kafka, which are big data platforms.
PipelineDB
- PostgreSQL Is Enough
-
The database inside out with event streams
I was experimenting with continuous sql queries in postgres for the same purpose. https://github.com/pipelinedb/pipelinedb
-
Ask HN: Is there a way to subscribe to an SQL query for changes?
PipelineDB might be of interest. https://github.com/pipelinedb/pipelinedb
What are some alternatives?
pgbouncer - lightweight connection pooler for PostgreSQL
TinyDB - TinyDB is a lightweight document oriented database optimized for your happiness :)
psycopg2 - PostgreSQL database adapter for the Python programming language
PyPika - PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
citus - Distributed PostgreSQL as an extension
pickleDB - pickleDB is an open source key-value store using Python's json module.
Greenplum - Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.
ZODB - Python object-oriented database
pspg - Unix pager (with very rich functionality) designed for work with tables. Designed for PostgreSQL, but MySQL is supported too. Works well with pgcli too. Can be used as CSV or TSV viewer too. It supports searching, selecting rows, columns, or block and export selected area to clipboard.
MerkavaDB - A fast ordered NoSQL database.
SSShelf - An ORM for S3
dbj - Simple embedded in memory json database