Running Open-Source AI Models Locally with Ruby

• bumblebee

  10 1,196 9.1 Elixir

  Pre-trained Neural Network models in Axon (+ 🤗 Models integration) (by elixir-nx)

  

That's not bad at all!

There is also Nx and Bumblebee in Elixir land - it really changes the how one approaches running models in production. The fact that one can put together a service (or local process) running any model published to hugging face in a couple of lines of code is amazing.

[0] https://github.com/elixir-nx/bumblebee/blob/main/examples/ph...

[1] https://gist.github.com/toranb/8be408eaa97d5a5b795aec7d7fbee...

• ollama-ai

  1 85 6.3 Ruby

  A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.

> Although there’s no dedicated gem for Ollama yet

https://rubygems.org/gems/ollama-ai

https://github.com/gbaptista/ollama-ai

> A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally

To be fair, this just depends on Faraday and wrap the http API - it still doesn't automate ollama install etc.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project