maxwell
mint
Our great sponsors
maxwell | mint | |
---|---|---|
6 | 3 | |
3,909 | 1,328 | |
0.6% | 1.2% | |
7.8 | 7.5 | |
22 days ago | 2 months ago | |
Java | Elixir | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
maxwell
-
All the ways to capture changes in Postgres
we started using https://github.com/zendesk/maxwell its not perfect, e.g. its difficult to know who changed what, but we solved this by adding the the user performing the change to the mixin
-
similar bundle / approach to laravel-activitylog
You could consider some CDC software, which logs database queries (inserts, updates and deletes). For example maxwells daemon https://maxwells-daemon.io/
-
Best way to ETL the new rows in a table.
Or you could generate a Kafka queue from MariaDB directly with Maxwell.
- Zendesk to Be Acquired
-
CDC in Apache Airflow
Most of the solutions out there for doing CDC on MySQL involve using the transaction log. These include https://github.com/debezium/debezium , https://github.com/airbnb/SpinalTap, and https://github.com/zendesk/maxwell.
mint
-
Unpacking Elixir: Resilience
One example is HTTP libraries.
For instance, take Mint (https://github.com/elixir-mint/mint):
> Mint is different from most Erlang and Elixir HTTP clients because it provides a process-less architecture.
Mint is a low-level library which doesn't make attempt to manage processes (including HTTP pooling).
In contrast, Finch (which builds on top of Mint) includes pool management:
https://github.com/elixir-mint/mint#connection-management-an...
It can take someone a bit off guard when they realise that the library they use provide a "default pool" they were not aware of, and that it can become a bottleneck etc.
-
How to implement a disk cache plugin for Elixir's Req HTTP client?
> no error checking at all
Functions that raise always end in `!` in Elixir, or at least they should. Most have alternatives that return error tuples instead which you can pattern match on (this is what I recommend). You can read the docs for `get/2` (as opposed to `get!/2` which raises) here: https://hexdocs.pm/req/Req.html#get/2.
A common pattern is for the `!` version to call the version that doesn't raise, check the result, and raise on error, which is the case here: https://github.com/wojtekmach/req/blob/9de30de0df481ee557ccc...
> and if "body" is JSON, how do you even get the raw body, or can you?
You would set `decode: false` when calling `get!/2: https://hexdocs.pm/req/Req.html#new/1. You can also set this as configuration with https://hexdocs.pm/req/Req.html#default_options/1.
As a closing note I'll mention that Req is intended to be a very high-level, scripting-friendly requests library, similar to Requests in Python. If you don't want conveniences like Req provides, you can either turn them off or use something different, like Finch (which Req is based on, https://github.com/sneako/finch). Other than Req and Finch I'm personally only familiar with HTTPoison, which is significantly older than all of the libraries derived from Mint (like Finch and Req, https://github.com/elixir-mint/mint) but still works. There are many others though, like Gun and Tesla and such.
- ElixirのHTTPクライアントでお天気情報を取得したい(2022年)
What are some alternatives?
debezium - Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
finch - Elixir HTTP client, focused on performance
SpinalTap - Change Data Capture (CDC) service
gun - HTTP/1.1, HTTP/2, Websocket client (and more) for Erlang/OTP.
auditor-bundle - The missing audit log library
Crawly - Crawly, a high-level web crawling & scraping framework for Elixir.
tesla - The flexible HTTP client library for Elixir, with support for middleware and multiple adapters.
http_proxy - http proxy with Elixir. wait request with multi port and forward to each URIs
hackney - simple HTTP client in Erlang
lhttpc - What used to be here -- this is a backwards-compat user and repo m(
talk-transcripts - Transcripts of Clojure-related talks
ivar - Ivar is an adapter based HTTP client that provides the ability to build composable HTTP requests.