pgsink
ht
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pgsink
-
GitHub - go-jet/jet: Type safe SQL builder with code generation and automatic query result data mapping
This is a really awesome project. I’ve used it on https://github.com/lawrencejones/pgsink to generate type safe bindings to the Postgres catalog tables, along with a few of the tables the project maintains itself.
-
Trade-offs from using ULIDs at incident.io
pgx is really good: it's what I used to write logical decoders in https://github.com/lawrencejones/pgsink
-
A modern data stack for startups
It used to be that companies would write their own hacky scripts to perform this extraction - I've had terrible incidents caused by ETL database triggers in the past, and even built a few generic ETL tools myself.
- Sync Postgres to BigQuery, possible? How?
-
Ask HN: Show me your Half Baked project
Postgres change-capture device that supports high-throughput and low-latency capture to a variety of sinks (at first release, just Google BigQuery):
https://github.com/lawrencejones/pgsink
I know there's debezium and Netflix's dblog, but this project aims to be much simpler.
Forget about kafka and any other dependency: just point it at Postgres, and your data will be pushed into BigQuery. And for people with highly-performance-sensitive databases, the read workload has been designed with Postgres efficiency in mind.
I'm hoping pgsink could be a gateway drug to get small companies up and running with a data warehouse. If your datastore of choice is Postgres, it's a huge help to replicate everything into an analytics datastore. A similar tool has helped my company extract expensive work out of our primary database, which is super useful for scaling.
The project is 90% there, about 10hrs and some testing away from being useable. Once there, I'll be hitting up some start-up friends and seeing if they want to give it a whirl.
ht
-
Curl is now a CVE Numbering Authority
No need to use curl, make HTTP requests great again with https://github.com/ducaale/xh
-
Why people in Google hate Go?
Except when you actually enjoy things being fast. For example, HTTPie easily adds 0.5-1s delay to every request because it's written in Python, especially on the first invocation. xh (https://github.com/ducaale/xh), on the other hand, starts immediately because it's written in Rust. I very much like this trend.
-
HTTPie Desktop: cross-platform API testing client for humans
HTTPie is great and was a big improvement for me over cURL.
However, I ended up switching to xh[1] as it's significantly faster and I prefer its output.
https://github.com/ducaale/xh
-
Tell HN: Postman just wiped all my stuff
No, but unless portability is a concern or you're massively familiar with curl, you might want to consider xh. It's much more intuitive.
https://github.com/ducaale/xh
-
🐚🦀Comandos shell reescritos em Rust
xh
- Insomnia REST client now requires an account
-
The curl-wget Venn diagram
wget on the other hand, automatically converts the ñ to UTF-8 hex and resolves the link perfectly.
I've searched the curl manpage and couldn't find a way to solve this. Please help.
I'm having to use `xh --curl` [1] to "fix" the links before I pass them to curl.
[1] https://github.com/ducaale/xh
-
Get better with Vim one tip at a time
Very nice, you should add xh to the User-Agents though.
-
I Could Rewrite Curl
While not a rewrite - one recent tool for making http requests which i quite enjoy is:
https://github.com/ducaale/xh
It's basically python httpie rewritten in rust. my only gripe is that i keep forgetting that it exists - and that "xh" is for http and "xhs" is for https.
So i frequently end up with curl anyway:)
- xh: Friendly and fast tool for sending HTTP requests (HTTPie in Rust)
What are some alternatives?
pastty - Copy and paste across devices
rustdesk - An open-source remote desktop, and alternative to TeamViewer.
dupver - Deduplicating VCS for large binary files in Go
htmlq - Like jq, but for HTML.
DataflowTemplates - Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
httpie - 🥧 HTTPie CLI — modern, user-friendly command-line HTTP client for the API era. JSON support, colors, sessions, downloads, plugins & more.
debezium-examples - Examples for running Debezium (Configuration, Docker Compose files etc.)
gitoxide - An idiomatic, lean, fast & safe pure Rust implementation of Git
xact - Model based design for developers
tty-share - Share your linux or osx terminal over the Internet.
dbt-metabase - dbt + Metabase integration
thgtoa - The Hitchhiker’s Guide to Online Anonymity