BigDL
gemma.cpp
BigDL | gemma.cpp | |
---|---|---|
5 | 8 | |
6,099 | 5,600 | |
17.8% | 9.1% | |
9.9 | 9.3 | |
7 days ago | 3 days ago | |
Python | C++ | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
BigDL
- PyTorch Library for Running LLM on Intel CPU and GPU
-
LLaMA Now Goes Faster on CPUs
Any performance benchmark against intel's 'IPEX-LLM'[0] or others?
[0] - https://github.com/intel-analytics/ipex-llm
- BigDL-LLM: running LLM on your laptop using INT4
- Fast, distributed, secure AI for Big Data
-
Machine learning on JVM
Intel BigDL for Spark which again is for Spark.
gemma.cpp
-
LLaMA Now Goes Faster on CPUs
For C++, also check out our https://github.com/google/gemma.cpp/blob/main/gemma.cc, which has direct calls to MatVec.
- FLaNK Stack 26 February 2024
-
Gemma.cpp: lightweight, standalone C++ inference engine for Gemma models
Looks like they're working on it: https://github.com/google/gemma.cpp/issues/16
- Source code of Google Gemma model in C++
-
Gemma: New Open Models
They have implemented the model also on their own C++ inference engine: https://github.com/google/gemma.cpp
What are some alternatives?
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
llamafile - Distribute and run LLMs with a single file.
Zeppelin - Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
mud-pi - A simple MUD server in Python, for teaching purposes, which could be run on a Raspberry Pi
Axle - Axle Domain Specific Language for Scientific Cloud Computing and Visualization
gemma_pytorch - The official PyTorch implementation of Google's Gemma models
deequ - Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
gemma - Open weights LLM from Google DeepMind.
Spire - Powerful new number types and numeric abstractions for Scala.
xpk - xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
PredictionIO - PredictionIO, a machine learning server for developers and ML engineers.
htmx - </> htmx - high power tools for HTML