Simplest Guide to DIY Your Own LLM Toy in 2024

• emqx

  7 13,235 10.0 Erlang

  The most scalable open-source MQTT broker for IoT, IIoT, and connected vehicles

  

EMQX (optional): Open-source MQTT broker for IoT, IIoT, and connected vehicles. Used for managing your toys.

• docker

  152 516 0.0 Go

  Docker - the open-source application container engine (by microsoft)

  

Docker (required): Understanding Docker is crucial for deploying software in containers, making your project portable and scalable. I use it for start Folo server.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ollama

  196 58,943 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

ollama (optional): If you want to run large language models locally, it's a good chooise.

• mqtt.org

  28 5,061 7.3 SCSS

  The mqtt.org website

  

MQTT (optional): If you're aiming for advanced customization, familiarity with MQTT (a lightweight messaging protocol) will be beneficial for communicating between the toy and the server.

Suggest a related project