ruby-openai VS ruby_llm

What’s the relationship, if any, with https://github.com/alexrudall/ruby-openai ?

That gem is actively maintained and widely used. It’s a good gem! But by definition they’re always playing catch up.

If you are using Open AI's API, this tokenizer is more accurate than the one coming with `ruby-openai` gem.

ruby-openai

If you can just interact with OpenAI api directly without langchain then that eliminates need for python. Here’s a gem for interacting with the OpenAI api : https://github.com/alexrudall/ruby-openai

There is a gem developed by Alex - https://github.com/alexrudall/ruby-openai.

I've been playing with ruby-openai, a Ruby gem (ie, library) that interfaces with the OpenAI API. I'm building myself a small movie-recommendation tool, just a personal need, as well as to teach myself how this stuff works. It's unlikely I'll ever build it into a proper app, as I'm okay with interacting in the shell and with text files, versus a web-based thing. But if there's interest, I'll push my tool up to Github.

Can use https://github.com/alexrudall/ruby-openai to do this sort of thing also :)

Then, building RubyLLM and Chat with Work, I noticed that LLM communication is async Ruby's killer app. The unique demands of streaming AI responses -- long-lived connections, token-by-token delivery, thousands of concurrent conversations -- expose exactly why async matters.

Want to shape RubyLLM's future? Join us on GitHub.