mack

Delta Lake helper methods in PySpark (by MrPowers)

Mack Alternatives

Similar projects and alternatives to mack based on common topics and language

  • delta-rs

    A native Rust library for Delta Lake, with bindings into Python

  • chispa

    12 mack VS chispa

    PySpark test helper methods with beautiful error messages

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • quinn

    9 mack VS quinn

    pyspark methods to enhance developer productivity 📣 👯 🎉 (by MrPowers)

  • os-lib

    4 mack VS os-lib

    OS-Lib is a simple, flexible, high-performance Scala interface to common OS filesystem and subprocess APIs

  • jodie

    2 mack VS jodie

    Delta lake and filesystem helper methods (by MrPowers)

  • ibis

    23 mack VS ibis

    the portable Python dataframe library

  • petastorm

    2 mack VS petastorm

    Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better mack alternative or higher similarity.

mack reviews and mentions

Posts with mentions or reviews of mack. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-03-05.
  • Implementing and using SCD Type 2
    1 project | /r/dataengineering | 4 Jul 2023
    There still library form databricks? But I have never used it: https://github.com/MrPowers/mack
  • Spark/databricks seems amazing?
    1 project | /r/dataengineering | 5 Apr 2023
    I was a Databricks user for 5 years and spent almost all my time inside the IntelliJ IDE developing code. I wrote almost all code in a text editor, unit tested all code (actually authored the popular Scala Spark / PySpark testing libraries: https://github.com/MrPowers/) and had everything up with CI/CD. Lots of OSS PySpark/Scala Spark work too. I only used Databricks notebooks for data exploration and for lightweight notebooks that would invoke functions (that were defined in Python Wheel / JAR files). I am on the Delta Lake team at Databricks now and still do all my work in text editors (see this project: https://github.com/MrPowers/mack) and create lots of examples in Jupyter Notebooks. So I definitely think it's possible to limit notebook exposure.
  • PySpark OSS Contribution Opportunity
    3 projects | /r/apachespark | 5 Mar 2023
    Great, would love your help. You can also check out the mack project if you'd like to work on a Delta Lake + PySpark project: https://github.com/MrPowers/mack/issues
  • Spark open source community is awesome
    5 projects | /r/apachespark | 29 Dec 2022
    a couple devs just added a `find_compositite_keys_candidates` function so users can easily identify columns that could be used as a unique identifier in their Delta table.
  • How to append data to Delta tables without adding any duplicates
    1 project | /r/apachespark | 20 Dec 2022
    Fair points. Here's the code repo: https://github.com/MrPowers/mack
  • A note from our sponsor - WorkOS
    workos.com | 24 Apr 2024
    The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Stats

Basic mack repo stats
5
269
5.9
3 months ago

MrPowers/mack is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of mack is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com