flake
| flake | guix-nonfree | |
|---|---|---|
| 5 | 1 | |
| 593 | - | |
| 3.9% | - | |
| 4.4 | - | |
| 7 days ago | - | |
| Nix | ||
| GNU Affero General Public License v3.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flake
- Running AI Models on NixOS
- Nixified.Ai Release 2
-
Llama.cpp: Full CUDA GPU Acceleration
> Ideally, there's Nix (and poetry2nix) that could take care of everything, but only a few folks write Flakes for their projects.
Relevant to "AI, Python, setting up is hard ... nix", there's stuff like:
https://github.com/nixified-ai/flake
-
Can you substitute conda with Nix for Data Science and ML/AI?
However, I would reach out to the Nixified.ai folks about it, because I can see that the invoke.ai build script mentions pytorch and several other hard-to-install packages (albeit not detectron).
- A Nix flake for many AI projects
guix-nonfree
-
GNU Guix 1.3.0 Released
Recommended to install a non-free repo such as https://gitlab.com/mbakke/guix-nonfree for wifi and KDE etc..
Otherwise it's great if not as mature as Nix. Guile is nice and shepherd is cool
What are some alternatives?
nonguix - Nonguix mirror – pull requests ignored, please use upstream for that
guix-nonfree - Unofficial collection of packages that are not going to be accepted in to guix
nonguix
lit-llama - Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
flake - My computing life in Nix.
llama_cpp.rb - llama_cpp provides Ruby bindings for llama.cpp
Home Manager using Nix - Manage a user environment using Nix [maintainer=@rycee]
serving - A flexible, high-performance serving system for machine learning models
TokenHawk - WebGPU LLM inference tuned by hand [Moved to: https://github.com/kayvr/token-hawk]
jibyconf - Configuration scripts for deploying my dev workspace using Ansible playbooks and Stow