Transformers.jl

Julia Implementation of Transformer models (by chengchingwen)

Transformers.jl Alternatives

Similar projects and alternatives to Transformers.jl

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Transformers.jl alternative or higher similarity.

Transformers.jl reviews and mentions

Posts with mentions or reviews of Transformers.jl. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-12-27.
  • Julia 1.10 Released
    15 projects | news.ycombinator.com | 27 Dec 2023
    Flux is quite a nice lower level library:

    https://github.com/FluxML/Flux.jl

    On top of that there are many higher level libraries such as Transformers.jl

    https://github.com/chengchingwen/Transformers.jl

  • How is Julia Performance with GPUs (for LLMs)?
    2 projects | /r/Julia | 7 Apr 2023
  • Load a transformer model with julia
    2 projects | /r/Julia | 17 Oct 2022
    Check out Transformers.jl. It’s a library that implements transformer based models in Julia using Flux.jl. They have support for some of the huggingface transformers.
  • Ask HN: Why hasn't the Deep Learning community embraced Julia yet?
    3 projects | news.ycombinator.com | 11 Sep 2022
    https://github.com/chengchingwen/Transformers.jl but I have not had any personal experience with.

    All of this is build by the community and your mileage may vary.

    In my rather biased opinion the strengths of Julia are that the various ML libraries can share implementations, e.g. Pytorch and Tensorflow contain separate Numpy derivatives. One could say that you can write an ML framework in Julia, instead of writting a DSL in Python as part of your C++ ML library. As an example Julia has a GPU compiler so you can write your own layer directly in Julia and integrate it into your pipeline.

  • Help on Differentiable Programming
    1 project | /r/Julia | 5 Jan 2022
    I think you might have some luck with looking at a transformers implementation in flux, e.g: https://github.com/chengchingwen/Transformers.jl/tree/master/src/basic
  • Fastai.jl: Fastai for Julia
    6 projects | news.ycombinator.com | 27 Jul 2021
    Having tried fastai for a "serious" research project and helped (just a bit) towards FastAI.jl development, here's my take:

    > motivation behind this is unclear.

    Julia currently has two main DL libraries. Flux, which is somewhere between PyTorch and (tf.)Keras abstraction wise, and Knet, which is a little lower level (think just below PyTorch/around where MXNet Gluon sits). Frameworks like fastai, PyTorch Lightning and Keras demonstrate that there's a desire for higher-level, more batteries included libraries. FastAI.jl is looking to fill that gap in Julia.

    > Since FastAI.jl uses Flux, and not PyTorch, functionality has to be reimplemented. FastAI.jl has vision support but no text support yet.

    This is correct. That said, FastAI.jl is not and does not plan to be a copy of the Python API (hence "inspired by"). One consequence of this is that integration with other libraries is much easier, e.g. https://github.com/chengchingwen/Transformers.jl for NLP tasks.

    > What is the timeline for FastAI.jl to achieve parity?

  • Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?
    17 projects | news.ycombinator.com | 18 Jan 2021
    If NLP primitives are all that's keeping you from testing the waters, have a look at https://github.com/chengchingwen/Transformers.jl.
  • A note from our sponsor - WorkOS
    workos.com | 26 Apr 2024
    The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more β†’

Stats

Basic Transformers.jl repo stats
7
503
6.9
2 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com