Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Anima Alternatives
Similar projects and alternatives to Anima
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Local-LLM-Langchain
Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Anima reviews and mentions
- AirLLM
- AirLLM enables 8GB MacBook run 70B LLM
-
Fitting 70B models in a 4gb GPU, The whole model, no quants or distil or anything!
Found out about air_llm, https://github.com/lyogavin/Anima/tree/main/air_llm, where it loads one layer at a time, allow each layer to be 1.6GB for a 70b with 80 layers. theres about 30mb for kv cache, and i'm not sure where the rest goes.
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Apr 2024
Stats
lyogavin/Anima is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of Anima is Jupyter Notebook.
Sponsored