pycall.rb VS boxcars

Yeah, I know there are few libraries that do similar things: pycall.rb and rb_call, and there is also rubypython, but it's not supported and doesn't work with Python 3. I used pycall to create matplotlib charts from Ruby, it's great, and I'm gonna use part of its code, type conversion implementation, for example. But I don't think it's enough, it's like a one way bridge, I want more, I want to call Python from Ruby and Ruby from Python at the same time: create an Airfow PythonOperator, invoke Ruby code inside, store some value into XCom. What about rb_call, I don't like how it's implemented at all, it starts a separate process and serializes data using MessagePack RPC, so you can't use callbacks. It's not even possible to pass a Python object as an argument or call Ruby method that requires a block. And of course it's not effective.

I have build a rails app that uses openai gem and it's working very well. For more advanced things I am exploring Pycall: https://github.com/mrkn/pycall.rb to call python functions. Don't have any experience though.

I have use this before cool and easy also could run in heroku ()( for my case https://github.com/mrkn/pycall.rb

From docs. I was able to install matplotlib (without --pre):

We use https://github.com/mrkn/pycall.rb extensively to interface with python libraries. So far, the only problem we have is memory leaks in python, but we mitigated the problem by isolating the leaking parts in a separate process.

currently in the same boat as you at my company, we've been looking at Boxcars and LangchainRB as our gems but they're pretty new to the scene so not sure about that. I love the idea of langchain for the extensibility of it though - we used the ruby-openai gem for a while but it didn't do what we needed. I'll come back in a week or two with with what we decide (python microservice with flask served api endpoints vs ruby all the way)

I started with Langchain, but I had a hell of time debugging and tweaking the framework to suit my needs. Next, I shifted to Boxcars, which has fewer abstractions. While Boxcars was easier to understand, I still struggled when things behaved differently than I’d expected. Finally, I said screw it…I’m not doing that much:

We ported the core of LangChain to Ruby, and while it is way more that 100 lines, I would give similar feedback as the author. Here is the repo if anyone is interested https://github.com/BoxcarsAI/boxcars