Spark-cassandra-connector Alternatives

Similar projects and alternatives to spark-cassandra-connector based on common topics and language

deequ

17 3,119 7.5 Scala spark-cassandra-connector VS deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Quill

15 2,136 9.1 Scala spark-cassandra-connector VS Quill

Compile-time Language Integrated Queries for Scala
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
zio-protoquill

6 195 8.6 Scala spark-cassandra-connector VS zio-protoquill

Quill for Scala 3
Phantom

1 1,047 0.0 Scala spark-cassandra-connector VS Phantom

Schema safe, type-safe, reactive Scala driver for Cassandra/Datastax Enterprise
kafka-journal

2 110 9.0 Scala spark-cassandra-connector VS kafka-journal

Event sourcing journal implementation using Kafka as main storage
virgil

0 32 8.6 Scala spark-cassandra-connector VS virgil

A purely functional Cassandra client built using ZIO & Cats Effect on top of the Datastax Java Driver (by kaizen-solutions)
Apache Spark

101 38,320 10.0 Scala spark-cassandra-connector VS Apache Spark

Apache Spark - A unified analytics engine for large-scale data processing
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better spark-cassandra-connector alternative or higher similarity.

Suggest an alternative to spark-cassandra-connector

spark-cassandra-connector reviews and mentions

Posts with mentions or reviews of spark-cassandra-connector. We have used some of these posts to build our list of alternatives and similar projects.

Reading from cassandra in Spark does not return all the data when using JoinWithCassandraTable
1 project | /r/apachespark | 9 Mar 2022

This works perfectly fine and I get all the data I'm expecting. However if I change spark.cassandra.sql.inClauseToJoinConversionThreshold(see https://github.com/datastax/spark-cassandra-connector/blob/master/doc/reference.md) to something lower like 20 which means I hit the threshold (my cross-product is 10*10=100) and JoinWithCassandraTable will be used. I suddenly do not get all the data, and on top of that I get duplicated rows for some of the data. It looks like I'm completely missing some of the partition keys, and some of the partition keys return duplicated rows (this quick-analysis might however be wrong).