SaaSHub helps you find the best software and product alternatives Learn more →
SpikeGPT Alternatives
Similar projects and alternatives to SpikeGPT
-
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
RWKV-LM-LoRA
RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better SpikeGPT alternative or higher similarity.
SpikeGPT reviews and mentions
Posts with mentions or reviews of SpikeGPT.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-10.
-
why don't somebody adapt this with pygmalionai ?
it seems to be trainable with a data . GitHub - ridgerchu/SpikeGPT: Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"
-
[D] The Complete Guide to Spiking Neural Networks
The relationship is that SpikeGPT is inspired/is an implementation of RWKV with SNNs.
-
[P] New toolchain to train robust spiking NNs for mixed-signal Neuromorphic chips
Have you already seen this? https://github.com/ridgerchu/SpikeGPT
-
[R] RWKV 14B ctx8192 is a zero-shot instruction-follower without finetuning, 23 token/s on 3090 after latest optimization (16G VRAM is enough, and you can stream layers to save more VRAM)
Soon :) working on it. Meanwhile take a look at https://github.com/ridgerchu/SpikeGPT which is a SNN version of RWKV, so has some explaination in the paper.
-
SpikeGPT: 230M-parameter Spiking Neural Network trained to be a language model
Found relevant code at https://github.com/ridgerchu/SpikeGPT + all code implementations here
-
A note from our sponsor - SaaSHub
www.saashub.com | 28 Apr 2024
Stats
Basic SpikeGPT repo stats
7
689
7.2
4 months ago
ridgerchu/SpikeGPT is an open source project licensed under BSD 2-clause "Simplified" License which is an OSI approved license.
The primary programming language of SpikeGPT is Python.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com