Torchdynamo Alternatives

Similar projects and alternatives to torchdynamo

server

24 7,314 9.5 Python torchdynamo VS server

The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)
deepsparse

21 2,866 9.6 Python torchdynamo VS deepsparse

Sparsity-aware deep learning inference runtime for CPUs
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
BentoML

16 6,521 9.8 Python torchdynamo VS BentoML

The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
serve

11 3,949 9.6 Java torchdynamo VS serve

Serve, optimize and scale PyTorch models in production (by pytorch)
kernl

8 1,457 1.5 Jupyter Notebook torchdynamo VS kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
transformer-deploy

8 1,614 6.8 Python torchdynamo VS transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
openai-whisper-cpu

5 206 10.0 Jupyter Notebook torchdynamo VS openai-whisper-cpu

Improving transcription performance of OpenAI Whisper for CPU based deployment
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better torchdynamo alternative or higher similarity.

Suggest an alternative to torchdynamo

torchdynamo reviews and mentions

Posts with mentions or reviews of torchdynamo. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-10-28.

[D] How to get the fastest PyTorch inference and what is the "best" model serving framework?
8 projects | /r/MachineLearning | 28 Oct 2022

For 1), what is the easiest way to speed up inference (assume only PyTorch and primarily GPU but also some CPU)? I have been using ONNX and Torchscript but there is a bit of a learning curve and sometimes it can be tricky to get the model to actually work. Is there anything else worth trying? I am enthused by things like TorchDynamo (although I have not tested it extensively) due to its apparent ease of use. I also saw the post yesterday about Kernl using (OpenAI) Triton kernels to speed up transformer models which also looks interesting. Are things like SageMaker Neo or NeuralMagic worth trying? My only reservation with some of these is they still seem to be pretty model/architecture specific. I am a little reluctant to put much time into these unless I know others have had some success first.