fs2-kafka
parquet4s
Our great sponsors
| fs2-kafka | parquet4s | |
|---|---|---|
| 3 | 1 | |
| 286 | 271 | |
| 0.4% | - | |
| 8.6 | 8.3 | |
| about 16 hours ago | about 1 month ago | |
| Scala | Scala | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fs2-kafka
- Any FS2 + Kafka github projects for reference?
-
Need the advice to choose: FS2 vs ZIO-streams
If you only need statless transformations, I guess that fs2, zio-streams, and alpakka kafka are good solutions, and it's just a matter of personal preference. But zio and fs2 are definitely lightwheight when you compare it with akka streams. I see a lot of comments against ZIO streams that are not supported by the facts, since https://github.com/zio/zio-kafka has more contributors than https://github.com/fd4s/fs2-kafka. Here are some materials if you want to learn more about zio-kafka: https://www.youtube.com/watch?v=GECv1ONieLw https://scalac.io/blog/streaming-microservices-with-zio-and-kafka/
parquet4s
-
Advice for storing tick data in Google Cloud
I don't have experience with cloud, but we used https://github.com/mjakubowski84/parquet4s for storing data to HDFS with Akka Streams. It uses Hadoop libraries for actual writing so it supports various object stores like S3 and Google Cloud Storage.
What are some alternatives?
ZIO - ZIO — A type-safe, composable library for async and concurrent programming in Scala
registravka4s - RegistrAvKa4s - (Schema-)Registry, Avro and Kafka for Scala
zio-kafka - A Kafka client for ZIO and ZIO Streams
ClammyScan - [MIRROR] A Playframework BodyParser for scanning multipart file uploads with ClamAV
Http4s - A minimal, idiomatic Scala interface for HTTP
Pulsar4s - Idiomatic, typesafe, and reactive Scala client for Apache Pulsar
Snowplow - The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
Reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
todo-http4s-doobie - A sample project of a microservice using http4s, doobie, and circe.
seq-datasource-v2 - Sequence Data Source for Apache Spark
fs2-es - Event sourcing utilities for FS2
meteor - https://d2a4u.github.io/meteor/