tusker
StackStorm
tusker | StackStorm | |
---|---|---|
9 | 25 | |
201 | 5,921 | |
- | 0.7% | |
5.8 | 9.5 | |
4 months ago | 8 days ago | |
Python | Python | |
The Unlicense | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tusker
-
We built our customer data warehouse all on Postgres
Thanks! Yeah definitely agree that building out declarative table management for Postgres would be a major effort. A few open source projects I've seen in that area include:
https://github.com/sqldef/sqldef (Go)
https://github.com/bikeshedder/tusker (Python but being ported to Rust)
https://github.com/tyrchen/renovate (Rust)
https://github.com/blainehansen/postgres_migrator (Rust)
Some of these are based on parsing SQL, and others are based on running the CREATEs in a temporary location and introspecting the result.
The schema export side can be especially tricky for Postgres, since it lacks a built-in equivalent to MySQL's SHOW CREATE TABLE. So most of these declarative pg tools shell out to pg_dump, or require the user to do so. But sqldef actually implements CREATE TABLE dumping in pure Golang if I recall correctly, which is pretty cool.
There's also the question of implementing the table diff logic from scratch, vs shelling out to another tool or using a library. For the latter path, there's a nice blog post from Supabase about how they evaluated the various options: https://supabase.com/blog/supabase-cli#choosing-the-best-dif...
-
Ask HN: What are some unpopular technologies you wish people knew more about?
Big fan of tusker (https://github.com/bikeshedder/tusker) for PostgreSQL migrations. Tusker takes a SQL-first approach; You write your schema in declarative DDL (I have my entire project in one schema.sql file) and when you edit it, tusker generates the sql code required to migrate. It uses temporary test databases to run both your declarative DDL and your step-by-step migrations to ensure they are in lock step. And it can connect to live databases and diff your schema/migrations against reality. I've never seen a better toolkit for schema evolution.
-
Pgroll: zero-downtime, undoable, schema migrations for Postgres
Forr postgres, how does the schema diffing aspect compare to migra?
https://github.com/djrobstep/migra
I'm asking because, although migra is excellent and there are multiple migrations tools based on it (at least https://github.com/bikeshedder/tusker and https://github.com/blainehansen/postgres_migrator), issues are piling up but development seem to be slowing down
-
Diesel 2.1
Is this similar to migra? There's a tool written in Rust that calls it, postgres_migrator (there's also tusker)
-
Ask HN: ORM or Native SQL?
The best solution I've ever seen is this Rust library https://github.com/cornucopia-rs/cornucopia
You write plain SQL for you schema (just a schema.sql is enough) and plain SQL functions for your queries. Then it generates Rust types and Rust functions from from that. If you don't use Rust, maybe there's a library like that for your favorite language.
Optionally, pair it with https://github.com/bikeshedder/tusker or https://github.com/blainehansen/postgres_migrator (both are based off https://github.com/djrobstep/migra) to generate migrations by diffing your schema.sql files, and https://github.com/rust-db/refinery to perform those migrations.
Now, if you have simple crud needs, you should probably use https://postgrest.org/en/stable/ and not an ORM. There are packages like https://www.npmjs.com/package/@supabase/postgrest-js (for JS / typescript) and probably for other languages too.
If you insist on an ORM, the best of the bunch is prisma https://www.prisma.io/ - outside of the typescript/javascript ecosystem it has ports for some other languages (with varying degrees of completion), the one I know about is the Rust one https://prisma.brendonovich.dev/introduction
- Tusker: PostgreSQL Migration Management Tool
-
Migra: Like Diff but for PostgreSQL Schemas
> Tusker actually uses Migra to power its functionality: https://github.com/bikeshedder/tusker#how-does-it-Work
What a twist! Might we ask what field you work in? Seems niche
StackStorm
- Ask HN: What are some unpopular technologies you wish people knew more about?
- StackStorm – IFTTT for Ops
-
Small app using a DB?
Stackstorm
-
We built Activepieces to replace Zapier + learnings from last post
What differentiates this from things like n8n, node red, and stackstorm? (which sort of occupy a zapier replacement, IoT automation, and infra automation niche, respectively)
- SRE: What tool do you use for Incident Response Runbook/Playbook
-
IT Capstone Project Ideas
Network Automation is interesting topic, something like event driven automation would be cool. StackStorm is what comes to mind for a tool/resource.
-
Hacker News top posts: Nov 24, 2022
StackStorm: Event-driven automation\ (17 comments)
- StackStorm (a.k.a. “IFTTT for Ops”) is event-driven automation
-
What Open Source Projects Do You Use In Your District?
StackStorm -- "IFTTT For Ops" I am investigating the different integrations to see if it can help automate some things.
What are some alternatives?
migra - Like diff but for PostgreSQL schemas
Rundeck - Enable Self-Service Operations: Give specific users access to your existing tools, services, and scripts
pgroll - PostgreSQL zero-downtime migrations made easy
n8n - Free and source-available fair-code licensed workflow automation tool. Easily automate tasks across different services.
sqldef - Idempotent schema management for MySQL, PostgreSQL, and more
argo - Workflow Engine for Kubernetes
SQLMonitor - SQL Server monitor, manages sql server performance, monitor sql server processes and jobs, analyze performance, analyse system, object version control, view executing sql query, kill process / job, object explorer, database shrink/log truncate/backup/detach/attach.
Node RED - Low-code programming for event-driven applications
OpenDBDiff - A database comparison tool for Microsoft SQL Server 2005+ that reports schema differences and creates a synchronization script.
Huginn - Create agents that monitor and act on your behalf. Your agents are standing by!
pg-osc - Easy CLI tool for making zero downtime schema changes and backfills in PostgreSQL
SaltStack - Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here: