tispark VS parquet4s

Compare tispark vs parquet4s and see what are their differences.

tispark

TiSpark is built for running Apache Spark on top of TiDB/TiKV (by pingcap)
Bigdata Spark Tidb Tikv
Source Code
Suggest alternative
Edit details

parquet4s

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster. (by mjakubowski84)
Parquet Scala Hadoop akka-streams Akka Streams Reader Writer parquet-files AWS google-storage Fs2 Bigdata
Source Code
mjakubowski84.github.io
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
tispark parquet4s
2 1
878 271
0.0% -
5.1 8.3
26 days ago about 2 months ago
Scala Scala
Apache License 2.0 MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

tispark

Posts with mentions or reviews of tispark. We have used some of these posts to build our list of alternatives and similar projects.
  • A simple way to import TiSpark into Databricks to load TiDB data
    1 project | dev.to | 16 Sep 2022
    dbutils.fs.mkdirs("dbfs:/databricks/scripts/") dbutils.fs.put( "/databricks/scripts/tispark-install.sh", """ #!/bin/bash wget --quiet -O /mnt/driver-daemon/jars/tispark-assembly-3.2_2.12-3.1.0-SNAPSHOT.jar https://github.com/pingcap/tispark/releases/download/v3.1.0/tispark-assembly-3.2_2.12-3.1.0.jar """, True)
  • Understand TiSpark pushdown
    1 project | dev.to | 6 Sep 2022
    TiSpark is a thin layer built for running Apache Spark on top of TiKV/TiFlash to answer complex OLAP queries. It supports reading, writing, and deleting from TiKV/TiFlash with the guarantee of transactions.

parquet4s

Posts with mentions or reviews of parquet4s. We have used some of these posts to build our list of alternatives and similar projects.
  • Advice for storing tick data in Google Cloud
    1 project | /r/scala | 25 Jan 2021
    I don't have experience with cloud, but we used https://github.com/mjakubowski84/parquet4s for storing data to HDFS with Akka Streams. It uses Hadoop libraries for actual writing so it supports various object stores like S3 and Google Cloud Storage.

What are some alternatives?

When comparing tispark and parquet4s you can also consider the following projects:

incubator-livy - Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

registravka4s - RegistrAvKa4s - (Schema-)Registry, Avro and Kafka for Scala

ClammyScan - [MIRROR] A Playframework BodyParser for scanning multipart file uploads with ClamAV

fs2-kafka - Functional Kafka Streams for Scala

Pulsar4s - Idiomatic, typesafe, and reactive Scala client for Apache Pulsar

Reactive-kafka - Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

meteor - https://d2a4u.github.io/meteor/

seq-datasource-v2 - Sequence Data Source for Apache Spark

Cinchoo ETL - ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

spline - Data Lineage Tracking And Visualization Solution

tispark vs incubator-livy parquet4s vs registravka4s parquet4s vs ClammyScan parquet4s vs fs2-kafka parquet4s vs Pulsar4s parquet4s vs Reactive-kafka parquet4s vs meteor parquet4s vs seq-datasource-v2 parquet4s vs Cinchoo ETL parquet4s vs spline