Flaxformer Alternatives

Similar projects and alternatives to flaxformer

nanoGPT

69 32,404 4.4 Python flaxformer VS nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better flaxformer alternative or higher similarity.

Suggest an alternative to flaxformer

flaxformer reviews and mentions

Posts with mentions or reviews of flaxformer. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-24.

Transformer Attention is off by one
4 projects | news.ycombinator.com | 24 Jul 2023

I can't find it in PyTorch in the current version, so it may be outdated, as their softmax appears to be the regular kind, with no other variants listed for this. It has been in flaxformer for a couple years now though, however it claims to be a compatibility variant for older models [1] and I haven't seen any mention of it in their recent papers (though I've not checked exhaustively).
[1]: https://github.com/google/flaxformer/blob/main/flaxformer/co...