InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises. Learn more →
Spark-fast-tests Alternatives
Similar projects and alternatives to spark-fast-tests
-
-
Prefect
The easiest way to build, run, and monitor data pipelines at scale.
-
SonarLint
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
-
-
soda-sql
Data profiling, testing, and monitoring for SQL accessible data.
-
sqlfluff
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
-
dagster
An orchestration platform for the development, production, and observation of data assets.
-
airbyte
Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
Metabase
The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
-
-
lowdefy
An open-source, self-hosted, low-code framework to build internal tools, web apps, admin panels, BI dashboards, workflows, and CRUD apps with YAML or JSON.
-
quinn
pyspark methods to enhance developer productivity 📣 👯 🎉 (by MrPowers)
-
snipp.in
Fast, Light-weight, Notes, Snippet manager and code editor directly inside your browser
-
-
-
gutenberg
A fast static site generator in a single binary with everything built-in. https://www.getzola.org
-
-
-
-
Nullboard
Nullboard is a minimalist kanban board, focused on compactness and readability.
-
Shynet
Modern, privacy-friendly, and detailed web analytics that works without cookies or JS.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better spark-fast-tests alternative or higher similarity.
spark-fast-tests reviews and mentions
Posts with mentions or reviews of spark-fast-tests.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-15.
-
Well designed scala/spark project
https://github.com/MrPowers/spark-fast-tests https://github.com/97arushisharma/Scala_Practice/tree/master/BigData_Analysis_with_Scala_and_Spark/wikipedia
-
Unit & integration testing in Databricks
If the majority of your stuff is not UDF-based there is an OS solution to run assertion tests against full data frames called spark-fast-tests. The idea here is similar in that you have a it notebook that calls your actual notebook against a staged input reads the output and compares it to a prefabed expected output. This does take a bit of setup and trial and error but it’s the closest I’ve been able to get to proper automated regression testing in databricks
-
Show dataengineering: beavis, a library for unit testing Pandas/Dask code
I am the author of spark-fast-tests and chispa, libraries for unit testing Scala Spark / PySpark code.
-
Ask HN: What are some tools / libraries you built yourself?
I built daria (https://github.com/MrPowers/spark-daria) to make it easier to write Spark and spark-fast-tests (https://github.com/MrPowers/spark-fast-tests) to provide a good testing workflow.
quinn (https://github.com/MrPowers/quinn) and chispa (https://github.com/MrPowers/chispa) are the PySpark equivalents.
Built bebe (https://github.com/MrPowers/bebe) to expose the Spark Catalyst expressions that aren't exposed to the Scala / Python APIs.
Also build spark-sbt.g8 to create a Spark project with a single command: https://github.com/MrPowers/spark-sbt.g8
-
Open source contributions for a Data Engineer?
I've built popular PySpark (quinn, chispa) and Scala Spark (spark-daria, spark-fast-tests) libraries.
-
A note from our sponsor - InfluxDB
www.influxdata.com | 5 Feb 2023
Stats
Basic spark-fast-tests repo stats
5
377
4.1
9 months ago
MrPowers/spark-fast-tests is an open source project licensed under MIT License which is an OSI approved license.
Popular Comparisons
- spark-fast-tests VS Prefect
- spark-fast-tests VS chispa
- spark-fast-tests VS soda-sql
- spark-fast-tests VS spark-daria
- spark-fast-tests VS sqlfluff
- spark-fast-tests VS dagster
- spark-fast-tests VS airbyte
- spark-fast-tests VS beavis
- spark-fast-tests VS Metabase
- spark-fast-tests VS databricks-nutter-projects-demo
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com