EasyDeL
gemma.cpp
| EasyDeL | gemma.cpp | |
|---|---|---|
| 2 | 8 | |
| 155 | 5,560 | |
| - | 8.4% | |
| 9.9 | 9.3 | |
| 7 days ago | 3 days ago | |
| Python | C++ | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
EasyDeL
- FLaNK Stack 26 February 2024
-
Gemma.cpp: lightweight, standalone C++ inference engine for Gemma models
This is not a production backend, as it says in the readme.
There are some very interesting efforts in JAX/TPU land like https://github.com/erfanzar/EasyDeL
gemma.cpp
-
LLaMA Now Goes Faster on CPUs
For C++, also check out our https://github.com/google/gemma.cpp/blob/main/gemma.cc, which has direct calls to MatVec.
- FLaNK Stack 26 February 2024
-
Gemma.cpp: lightweight, standalone C++ inference engine for Gemma models
Looks like they're working on it: https://github.com/google/gemma.cpp/issues/16
- Source code of Google Gemma model in C++
-
Gemma: New Open Models
They have implemented the model also on their own C++ inference engine: https://github.com/google/gemma.cpp
What are some alternatives?
llamafile - Distribute and run LLMs with a single file.
mud-pi - A simple MUD server in Python, for teaching purposes, which could be run on a Raspberry Pi
gemma_pytorch - The official PyTorch implementation of Google's Gemma models
gemma - Open weights LLM from Google DeepMind.
xpk - xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
htmx - </> htmx - high power tools for HTML
plantuml - Generate diagrams from textual description
prql - PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
lnav - Log file navigator
ibis - the portable Python dataframe library
lotion - An open-source Notion UI built with Vue 3
FLiPStackWeekly - FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...