spark-daria

Essential Spark extensions and helper methods ✨😲 (by mrpowers-io)

Spark-daria Alternatives

Similar projects and alternatives to spark-daria

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better spark-daria alternative or higher similarity.

spark-daria discussion

Log in or Post with

spark-daria reviews and mentions

Posts with mentions or reviews of spark-daria. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-04-13.
  • Lakehouse architecture in Azure Synapse without Databricks?
    2 projects | /r/dataengineering | 13 Apr 2023
    I was a Databricks user for 5 years and spent 95% of my time developing Spark code in IDEs. See the spark-daria and spark-fast-tests projects as Scala examples. I developed internal libraries with all the business logic. The Databricks notebooks would consist of a few lines of code that would invoke a function in the proprietary Spark codebase. The proprietary Spark codebase would depend on the OSS libraries I developed in parallel.
  • Is Spark - The Defenitive Guide outdated?
    2 projects | /r/apachespark | 1 Jul 2021
    They spent a lot of effort improving the catalyst engine under the hood too and making it easier to extend and improve it in the future. Making it easy to add your own native code to Spark itself. Shameless plug of a blog post I wrote on this subject which basically reiterates what Matthew Powers, author of Spark Daria and quinn, wrote here.
  • Ask HN: What are some tools / libraries you built yourself?
    264 projects | news.ycombinator.com | 16 May 2021
    I built daria (https://github.com/MrPowers/spark-daria) to make it easier to write Spark and spark-fast-tests (https://github.com/MrPowers/spark-fast-tests) to provide a good testing workflow.

    quinn (https://github.com/MrPowers/quinn) and chispa (https://github.com/MrPowers/chispa) are the PySpark equivalents.

    Built bebe (https://github.com/MrPowers/bebe) to expose the Spark Catalyst expressions that aren't exposed to the Scala / Python APIs.

    Also build spark-sbt.g8 to create a Spark project with a single command: https://github.com/MrPowers/spark-sbt.g8

  • Open source contributions for a Data Engineer?
    17 projects | /r/dataengineering | 16 Apr 2021
    I've built popular PySpark (quinn, chispa) and Scala Spark (spark-daria, spark-fast-tests) libraries.
  • A note from our sponsor - SaaSHub
    www.saashub.com | 14 Jan 2025
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic spark-daria repo stats
4
753
8.1
3 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you konow that Scala is
the 38th most popular programming language
based on number of metions?