Top 6 Python Flux Projects
-
I tried using TheLastBen's fast dreambooth trainer. I managed to train a ckpt file but I can't run it.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
it's become much easier in the last few years. Talos + Flux + Renovate can be built in a day [0], and simplifies storage/backups/patching even for single-node clusters. There's also a great community, with services like kubesearch [1] providing templates for tons of apps
[0] https://github.com/onedr0p/cluster-template
[1] https://kubesearch.dev
-
-
comfyui_LLM_party
LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage graphRAG / RAG
Project mention: Comfyui_LLM_party: LLM Agent Framework in ComfyUI | news.ycombinator.com | 2024-11-26 -
flux-fp8-api
Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.
Project mention: SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup | news.ycombinator.com | 2024-11-09Thats what I thought as well, but FP8 is much faster on h100, like 2x-3x. You can check it/s here: https://github.com/aredden/flux-fp8-api
Its why fal, replicate, pretty much all big diffusion api providers use h100
tldr; 4090 is max 3.51 it/s even with all the current optimizations. h100 is 11.5it/s with all optimizations, and even without its 6.1 it/s
-
Python Flux discussion
Index
What are some of the best open-source Flux projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | fast-stable-diffusion | 7,557 |
2 | cluster-template | 1,929 |
3 | fastsdcpu | 1,508 |
4 | comfyui_LLM_party | 1,076 |
5 | flux-fp8-api | 212 |
6 | flux-operator | 31 |