quine VS fs2-kafka

Quine

Re [5]'s asssertion under "blunders" of the diminish usecases post sql/pgq, what do you think of sometime like Quine?

https://github.com/thatdot/quine

Their claim to fame is progressive incremental computation - each node is an actor responding to events -- and I'm not sure how a relational db could do that and match the latencies. That usecase is pretty much pattern matching and forensics and stuff like that.

https://docs.quine.io/core-concepts/architecture.html

Download Quine - JAR file | Docker Image | Github

The first step to making a Standing Query is determining the graph pattern you want to watch for. You may have deployed Quine in your data pipeline to perform a series of tasks to isolate data, implement a specific feature, or monitor the stream to find a specific pattern in real time. In any case, Quine will implement your logic using Cypher. The recipe for this example is included in the Quine repo if you'd like to follow along.

Quine is open source if you want to run this analysis for yourself. Download a precompiled version or build it yourself from the codebase (Quine Github). I published the recipe that I developed at https://quine.io/recipes. The page has instructions for downloading the CSV files and running the recipe.

I welcome your feedback! Drop in to Quine Slack and let me know what you think. I'm always happy to discuss Quine or answer questions.

If you only need statless transformations, I guess that fs2, zio-streams, and alpakka kafka are good solutions, and it's just a matter of personal preference. But zio and fs2 are definitely lightwheight when you compare it with akka streams. I see a lot of comments against ZIO streams that are not supported by the facts, since https://github.com/zio/zio-kafka has more contributors than https://github.com/fd4s/fs2-kafka. Here are some materials if you want to learn more about zio-kafka: https://www.youtube.com/watch?v=GECv1ONieLw https://scalac.io/blog/streaming-microservices-with-zio-and-kafka/