Invitation to collaborate on open source PySpark projects

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/apachespark
#Pyspark #Testing #apache-spark

Our great sponsors
  • Sonar - Write Clean Python Code. Always.
  • InfluxDB - Build time-series-based applications quickly and at scale.
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • quinn

    pyspark methods to enhance developer productivity 📣 👯 🎉 (by MrPowers)

    quinn is a library with PySpark helper functions. I need to work through all the open issues / PRs and bump all versions. I should do another release. This library gets around 600,000 monthly downloads.

  • chispa

    PySpark test helper methods with beautiful error messages

    chispa is a library of PySpark testing functions.

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • dat

    Delta Acceptance Testing (by delta-incubator)

    Delta Acceptance Testing (dat) is a library that creates Delta Lake reference tables. This project is being done with the core Delta Lake devs. We need to build out all the reference tables and write tests to make sure PySpark can fully implement the Delta Lake protocol.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts