Our great sponsors
-
s3-sqs-connector
A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
- Provide maximum flexibility to your data team Author, schedule, and monitor data pipelines faster at scale on any cloud with the data processing engine of your choice with Qubole.
- Provide maximum flexibility to your data team Author, schedule, and monitor data pipelines faster at scale on any cloud with the data processing engine of your choice with Qubole.
- Struggling to install, configure and maintain huge data clusters? Get a single experience across any cloud with near-zero administration and maintenance with Qubole.
- Say goodbye to data silos Explore Qubole’s open, and secure multi-cloud data lake to get faster access to petabytes of datasets
- Upload to S3 -> AWS lambda with some Scala Spark code -> Process -> Write back to S3