seq-datasource-v2
parquet4s
seq-datasource-v2 | parquet4s | |
---|---|---|
1 | 1 | |
10 | 271 | |
- | - | |
0.0 | 8.3 | |
about 3 years ago | about 1 month ago | |
Scala | Scala | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
seq-datasource-v2
parquet4s
-
Advice for storing tick data in Google Cloud
I don't have experience with cloud, but we used https://github.com/mjakubowski84/parquet4s for storing data to HDFS with Akka Streams. It uses Hadoop libraries for actual writing so it supports various object stores like S3 and Google Cloud Storage.
What are some alternatives?
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
registravka4s - RegistrAvKa4s - (Schema-)Registry, Avro and Kafka for Scala
spark-daria - Essential Spark extensions and helper methods ✨😲
ClammyScan - [MIRROR] A Playframework BodyParser for scanning multipart file uploads with ClamAV
spline - Data Lineage Tracking And Visualization Solution
fs2-kafka - Functional Kafka Streams for Scala
Pulsar4s - Idiomatic, typesafe, and reactive Scala client for Apache Pulsar
Reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
meteor - https://d2a4u.github.io/meteor/
Cinchoo ETL - ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)