Mesh-transformer-jax Alternatives

Similar projects and alternatives to mesh-transformer-jax

jax

82 27,936 10.0 Python mesh-transformer-jax VS jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
mesh-transformer-jax

52 6,213 0.0 Python mesh-transformer-jax VS mesh-transformer-jax

Model parallel transformers in JAX and Haiku
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
the-pile

15 1,403 0.0 Python mesh-transformer-jax VS the-pile

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better mesh-transformer-jax alternative or higher similarity.

Suggest an alternative to mesh-transformer-jax

mesh-transformer-jax reviews and mentions

Posts with mentions or reviews of mesh-transformer-jax. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-06-08.

GPT-J-6B, a 6B Parameter Text Generation Model
5 projects | news.ycombinator.com | 8 Jun 2021

I'm running it quite comfortably on my 3090, although it's a really snug fit for the VRAM, and that's with a number of fixes to significantly reduce its memory use from https://github.com/AeroScripts/mesh-transformer-jax .