mamba.py

A simple and efficient Mamba implementation in PyTorch and MLX. (by alxndrTL)

Mamba.py Alternatives

Similar projects and alternatives to mamba.py

  • llama.cpp

    LLM inference in C/C++

  • MemGPT

    15 mamba.py VS MemGPT

    Create LLM agents with long-term memory and custom tools 📚🦙

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better mamba.py alternative or higher similarity.

mamba.py reviews and mentions

Posts with mentions or reviews of mamba.py. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-03-28.
  • AI21 Labs Unveils Jamba: The First Production-Grade Mamba-Based AI Model
    3 projects | news.ycombinator.com | 28 Mar 2024
    llama.cpp probably won't be getting Jamba support anytime soon: https://github.com/ggerganov/llama.cpp/issues/6372#issuecomm...

    There is an MLX Mamba implementation, but nothing for Jamba either: https://github.com/alxndrTL/mamba.py/tree/main/mlx

    You could run PyTorch on CPU and w/ a 12B activation pass, it might even run relatively fast (8 tok/s?), but a q4 quant would also easily fit on 2x3090s and should run at >60 tok/s.

Stats

Basic mamba.py repo stats
1
588
9.3
9 days ago

alxndrTL/mamba.py is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of mamba.py is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com