llama-lite
Embeddings focused small version of Llama NLP model (by skeskinen)
bert.cpp
ggml implementation of BERT (by skeskinen)
| llama-lite | bert.cpp | |
|---|---|---|
| 5 | 4 | |
| 99 | 443 | |
| - | - | |
| 8.3 | 6.3 | |
| about 1 year ago | 4 months ago | |
| C | C++ | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama-lite
Posts with mentions or reviews of llama-lite.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-27.
-
[P] bert.cpp, sentence embeddings in C++ with ggml
A while back I tried to make llama.cpp produce cheap sentence embeddings in https://github.com/skeskinen/llama-lite project
- llama-lite: a proof of concept fast sentence embeddings service based on llama.cpp (~1ms per token on CPU) (r/MachineLearning)
- llama-lite: a proof of concept fast sentence embeddings service based on llama.cpp (~1ms per token on CPU) (Useful in our recent ChaGPT plug-in tutorial)
- llama-lite: a proof of concept fast sentence embeddings service based on llama.cpp (~1ms per token on CPU) [P]
- llama-lite: a proof of concept fast sentence embeddings service based on llama.cpp (~1ms per token on CPU)
bert.cpp
Posts with mentions or reviews of bert.cpp.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-07.
-
Reality check on good embedding model (and this idea in general)
There is bert.cpp, which aims to implement the sentence-transormers models. https://github.com/skeskinen/bert.cpp
- Bert.cpp – Sbert on CPU optimized C
-
[P] bert.cpp, sentence embeddings in C++ with ggml
Project page: https://github.com/skeskinen/bert.cpp
What are some alternatives?
When comparing llama-lite and bert.cpp you can also consider the following projects:
Delphic - Starter App to Build Your Own App to Query Doc Collections with Large Language Models (LLMs) using LlamaIndex, Langchain, OpenAI and more (MIT Licensed)
awesome-vector-search - Collections of vector search related libraries, service and research papers