hydra
pg_tle
hydra | pg_tle | |
---|---|---|
27 | 9 | |
2,668 | 307 | |
1.8% | 2.6% | |
8.5 | 7.4 | |
13 days ago | 5 days ago | |
C | C | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
hydra
-
Using ClickHouse to scale an events engine
Don't feel bad, lots of people get bitten by not reading all the way down to the bottom of their readme: https://github.com/hydradatabase/hydra/blob/v1.1.2/README.md... While Hydra may very well license their own code Apache 2, they ship the AGPLv3 columnar which to my very best IANAL understanding taints the whole stack and AGPLv3's everything all the way through https://github.com/hydradatabase/hydra/blob/v1.1.2/columnar/...
-
Moving a Billion Postgres Rows on a $100 Budget
Columnar store PostgreSQL extension exists, here are two but I think I’m missing at least another one:
https://github.com/citusdata/cstore_fdw
https://github.com/hydradatabase/hydra
You can also connect other stores using the foreign data wrappers, like parquet files stored on an object store, duckdb, clickhouse… though the joins aren’t optimised as PostgreSQL would do full scan on the external table when joining.
- Hydra (YC W22) adds upsert to columnar Postgres
- Hydra
-
Is ClickHouse Moving Away from Open Source?
New column store alternative : https://github.com/hydradatabase/hydra
HN: https://news.ycombinator.com/item?id=37571974
-
Show HN: Hydra - Open-Source Columnar Postgres
some previous discussions:
https://news.ycombinator.com/item?id=37247945
https://news.ycombinator.com/item?id=36987920
and a relevant observation is that there are actually multiple license files in the repo so the consumer should read their explicit licensing section of the readme <https://github.com/hydradatabase/hydra#license> since the GitHub sidebar is misleading
-
CDC from postgres to postgres.
Hydra DB Link to Github -> Worked well for aggregated query usecases but not for queries that build reports. Also, data insertion and updation is abyssmal on columnar dbs.
-
How Query Engines Work
There's a lot of experience about db operation and how to approach MVCC encoded in PostgreSQL that shouldn't be underestimated.
[0]: https://github.com/hydradatabase/hydra
-
Hydra: Column-Oriented Postgres
And just like last time, watch out for the misleading GitHub license detector because it's not entirely Apache as the GitHub summary claims but rather *some* is Apache and buried in the interior is some AGPL stuff: https://github.com/hydradatabase/hydra#license
pg_tle
-
Pgcopydb: Copy a Postgres database to a target Postgres server
Have you tried this in databases with [TLE](https://github.com/aws/pg_tle)s?
-
Making PostgreSQL tick: New features in pg_cron
I dunno about other hosted Postgres providers, but not on AWS RDS no, as the Python extension is untrusted. Looks like you can use plv8 via pg_tle (Trusted Language Extensions) [1] though.
[1] https://github.com/aws/pg_tle
-
The Database Package Manager for PostgreSQL Trusted Language Extensions
Partially correct, this doesn't work with RDS as you can't install pgsql-http (a requirement for automatic install). However all the extensions listed are "Trusted Language Extensions for PostgreSQL" which was developed by AWS to enable installing extensions written in "Safe" languages. So I believe the all the extensions listed could bee installed manually.
https://github.com/aws/pg_tle
https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Postg...
-
Choosing a Postgres Primary Key
>pg_idkit to their list of supported extensions
For some of these simpler extensions, we're looking at using AWS's TLE (https://github.com/aws/pg_tle), which would allow user-contributed extensions. If we can pull that off, we'll probably look again at the current set of extensions we offer and then see which ones can be ported to a TLE instead
-
postgres extension managers
This is a new thing from AWS: https://github.com/aws/pg_tle. It lets you build extensions that people can use on RDS.
-
SQL Macros in YugabyteDB
I'm taking those functions from the examples in pg_tle, an extension that helps packaging those functions. The functions calculate the Manhattan and Euclidian distance:
- Trusted Language Extensions for PostgreSQL (Pg_tle)
- GitHub - aws/pg_tle: Framework for building trusted language extensions for PostgreSQL
- AWS releases open source Trusted Language Extensions for PostgreSQL
What are some alternatives?
duckdb - DuckDB is an in-process SQL OLAP Database Management System
supavisor - A cloud-native, multi-tenant Postgres connection pooler.
citus - Distributed PostgreSQL as an extension
omnigres - Postgres as a Platform
ClickHouse - ClickHouse® is a real-time analytics DBMS
set_user - PostgreSQL extension allowing privilege escalation with enhanced logging and control
postgres - PostgreSQL in Neon
sequential-uuids - generator of sequential UUIDs
Udacity-Data-Engineering-Projects - Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
vasco - vasco: Discover hidden patterns in your Postgres data
sql-examples - Curated list of SQL to help you find useful script easily 🚀