EleutherAI announces it has become a non-profit

1. emlearn

   1 5 604 7.8 Python

   Machine Learning inference engine for Microcontrollers and Embedded devices

   

   > My big gripe, and for obvious reasons, is that we need to step away from cloud-based inference, and it doesn't seem like anyone's working on that.

   I think there are steps being taken in this direction (check out [1] and [2] for interesting lightweight transpile / ad-hoc training projects) but there is a lack of centralized community for these constrained problems.

   [1] https://github.com/emlearn/emlearn

2. Judoscale

   judoscale.com featured

   Save 47% on cloud hosting with autoscaling that just works. Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.

   

3. m2cgen

   2 8 2,874 0.0 Python

   Transform ML models into a native code (Java, C, Python, Go, JavaScript, Visual Basic, C#, R, PowerShell, PHP, Dart, Haskell, Ruby, F#, Rust) with zero dependencies

   

4. Open-Assistant

   3 329 37,290 4.3 Python

   OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

   

   I was looking for open alternatives to self hosted, or crowd hosted finetuned LLMs like ChatGPT and found LAION Open Assistant. Then found resources to further optimize inference as well as training:

   - Open source fine tuned assistants like LAION Open-Assistant [1]

   - inference optimizations like VoltaML, FlexGenm Distributed Inference [2]

   - training optimizations like Hivemind [2]

   1 https://github.com/LAION-AI/Open-Assistant

   2 https://github.com/underlines/awesome-marketing-datascience/...

5. awesome-ml

   4 27 2,275 8.6

   Curated list of useful LLM / Analytics / Datascience resources

   

   I was looking for open alternatives to self hosted, or crowd hosted finetuned LLMs like ChatGPT and found LAION Open Assistant. Then found resources to further optimize inference as well as training:

   - Open source fine tuned assistants like LAION Open-Assistant [1]

   - inference optimizations like VoltaML, FlexGenm Distributed Inference [2]

   - training optimizations like Hivemind [2]

   1 https://github.com/LAION-AI/Open-Assistant

   2 https://github.com/underlines/awesome-marketing-datascience/...

Suggest a related project