parquet4s
fs2-kafka
parquet4s | fs2-kafka | |
---|---|---|
1 | 3 | |
274 | 286 | |
- | 0.7% | |
8.3 | 8.6 | |
about 2 months ago | 3 days ago | |
Scala | Scala | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet4s
-
Advice for storing tick data in Google Cloud
I don't have experience with cloud, but we used https://github.com/mjakubowski84/parquet4s for storing data to HDFS with Akka Streams. It uses Hadoop libraries for actual writing so it supports various object stores like S3 and Google Cloud Storage.
fs2-kafka
- Any FS2 + Kafka github projects for reference?
-
Need the advice to choose: FS2 vs ZIO-streams
If you only need statless transformations, I guess that fs2, zio-streams, and alpakka kafka are good solutions, and it's just a matter of personal preference. But zio and fs2 are definitely lightwheight when you compare it with akka streams. I see a lot of comments against ZIO streams that are not supported by the facts, since https://github.com/zio/zio-kafka has more contributors than https://github.com/fd4s/fs2-kafka. Here are some materials if you want to learn more about zio-kafka: https://www.youtube.com/watch?v=GECv1ONieLw https://scalac.io/blog/streaming-microservices-with-zio-and-kafka/
What are some alternatives?
registravka4s - RegistrAvKa4s - (Schema-)Registry, Avro and Kafka for Scala
ZIO - ZIO — A type-safe, composable library for async and concurrent programming in Scala
ClammyScan - [MIRROR] A Playframework BodyParser for scanning multipart file uploads with ClamAV
zio-kafka - A Kafka client for ZIO and ZIO Streams
Pulsar4s - Idiomatic, typesafe, and reactive Scala client for Apache Pulsar
Http4s - A minimal, idiomatic Scala interface for HTTP
Reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
Snowplow - The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
meteor - https://d2a4u.github.io/meteor/
todo-http4s-doobie - A sample project of a microservice using http4s, doobie, and circe.
seq-datasource-v2 - Sequence Data Source for Apache Spark
fs2-es - Event sourcing utilities for FS2