deepspeed_testing

Repo for testing out the awesome DeepSpeed library. Used https://huggingface.co/transformers/master/main_classes/trainer.html#deepspeed for guidance. (by ncoop57)

Deepspeed_testing Alternatives

Similar projects and alternatives to deepspeed_testing

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better deepspeed_testing alternative or higher similarity.

deepspeed_testing reviews and mentions

Posts with mentions or reviews of deepspeed_testing. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-05-03.
  • DeepSpeed Investigation: What I Learned
    2 projects | dev.to | 3 May 2021
    To test out DeepSpeed, I used the awesome HuggingFace transformers library, which supports using DeepSpeed on their non-stable branch (though support is coming to the stable branch in 4.6 🤓). I followed these awesome instructions on the HuggingFace’s website for getting started with DeepSpeed and HuggingFace. If you want to follow along at home, I created a Github repository with the Dockerfile (I’m addicted to docker and will probably make a blog post on docker too :)) and the test script I used to run my experiments on. I tried training the different versions of the awesome T5 model that ranged from smallish ~60 million parameters to humungous 3 billion parameters. And here are my results:

Stats

Basic deepspeed_testing repo stats
1
0
2.7
about 3 years ago

The primary programming language of deepspeed_testing is Shell.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com