sparktorch

Train and run Pytorch models on Apache Spark. (by dmmiller612)

Sparktorch Alternatives

Similar projects and alternatives to sparktorch

  1. pytorch-lightning

    Discontinued Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning] (by PyTorchLightning)

  2. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo
  3. BERT-NER

    1 sparktorch VS BERT-NER

    Pytorch-Named-Entity-Recognition-with-BERT

  4. fastT5

    ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

  5. openfl

    An Open Framework for Federated Learning. (by securefederatedai)

  6. pytorch-lightning

    Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.

  7. torch2trt

    An easy to use PyTorch to TensorRT converter

  8. polyaxon

    9 sparktorch VS polyaxon

    MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

  9. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  10. zenml

    35 sparktorch VS zenml

    ZenML 🙏: MLOps for Reliable AI: from Classical AI to Agents. https://zenml.io.

  11. Real-Time-Voice-Cloning

    Clone a voice in 5 seconds to generate arbitrary speech in real-time

  12. openfl

    9 sparktorch VS openfl

    An open source library for creative expression on the web, desktop, mobile and consoles. Inspired by the classic Flash and AIR APIs.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better sparktorch alternative or higher similarity.

sparktorch discussion

Log in or Post with

sparktorch reviews and mentions

Posts with mentions or reviews of sparktorch. We have used some of these posts to build our list of alternatives and similar projects.
  • Spark2 + pytorch on GPU
    1 project | /r/pytorch | 17 Sep 2021
    Was reading the documentation of sparktorch (https://github.com/dmmiller612/sparktorch) which says you need spark >= 2.4.4. But to the best of my knowledge spark2 doesn't have gpu compute capabilities. Does that mean it can only use cpu compute? Am I missing something?

Stats

Basic sparktorch repo stats
1
339
2.5
about 2 years ago

Sponsored
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io

Did you know that Python is
the 2nd most popular programming language
based on number of references?