Async Ruby
Finagle
Our great sponsors
Async Ruby | Finagle | |
---|---|---|
20 | 24 | |
1,967 | 8,741 | |
2.4% | 0.2% | |
7.8 | 7.1 | |
23 days ago | 7 days ago | |
Ruby | Scala | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Async Ruby
-
EventMachine Performance Spikes
The Async gem is the natural successor, It's actively maintained, and allows you write synchronous code is if it wasn't non-blocking, and most libraries don't need any special support for Async (exceptions are gems with C extensions that do I/O and DB libraries with connection pooling that would otherwise be thread-based).
-
Philosophy of Coroutines
https://github.com/socketry/async uses coroutines and I think in general it’s been a great model with very few downsides in practice.
-
Is ruby really slow?
There's async I/O. Here's a library that leans on Ruby 3's fiber scheduler.
-
Show HN: Goru, an experimental, Go-inspired concurrency library for Ruby
Hey folks, wanted to show this off and get feedback. Still early/experimental but there are quite a few concepts I'm excited about here. This project came about while writing a program in Go and loving its approach to concurrency. Being a long-time Rubyist I immediately started to think about what similar concepts might look like in Ruby.
I set out with two main design constraints:
1. Lightweight: I didn't want routines to be backed by fibers or threads. Having been involved some in the async project (https://github.com/socketry/async), I had some experience using fibers for concurrency but was curious if they could be avoided.
2. Explicitness: Routine behavior must be written to describe exactly how it is to behave. I always felt like concurrent code was hard to fully understand because of the indirection involved. On the spectrum between tedium and magical I wanted to err more on the side of tedium with Goru.
Goru routines are just blocks that are called once for every tick of the reactor. It is up to the developer to implement behavior in terms of a state machine, where on each tick the routine takes some action and then updates the state of the routine for the next tick. This fulfills both design constraints:
1. Because routines are just blocks, they weigh in at about ~345 bytes of memory overhead.
2. Routine behavior is explicit because it is written as a state machine inside the block.
Couple more features worth noting:
* Goru includes channels for buffered reading/writing (similar to channels in Go).
* Goru ships with primitives for non-blocking IO to easily build things like http servers.
Curious your thoughts!
- Twitter (re)Releases Recommendation Algorithm on GitHub
-
Simple MapReduce that melt my brain (yes, fibers there)
For those who are interested here is the question.
- How does Ruby handle parallel HTTP requests in separate threads?
-
Two months into learning Ruby, it is the most beautiful language I ever learned
Welcome! Ruby isn't exactly "dying", but the hype/popularity is definitely fading. This is primarily because Ruby is no longer "new", most of Ruby's popularity came from Rails, and now Rails is no longer the "new hotness". However, Ruby still has lots of awesome features and lots of awesome other libraries and frameworks, such as the new fancy irb gem that uses reline, nokogiri, chunky_png, the async gems, Dragon Ruby, SciRuby, Ronin, and the new Hanami web framework.
- Efficient IO in Linux with io_uring [pdf]
Finagle
-
Features of Project Loom incorporated in Java 21
Not sure about now but a few years back the company I worked for was heavily vested in Finagle [1] using Future pools. I'm sure virtual threads would only enhance this framework. Also, Spring and it's reactive webflux would probably benefit as well [2].
[1] https://twitter.github.io/finagle/
[2] https://docs.spring.io/spring-framework/reference/web/webflu...
-
Twitter (re)Releases Recommendation Algorithm on GitHub
Don't really see how "enterprise scala" has anything to do with this, scala is meant to be parallelized , that's like it's whole thing with akka / actors / twitter's finagle (https://twitter.github.io/finagle/)
-
Introduction to Bazel for Scala developers
Thank you. I only took a quick look, but this looks like a goldmine of info if you are interested in using bazel to build a scala monorepo: https://github.com/twitter/finagle
-
Server Stack Options for Scala
Finagle
-
Elon: "[Twitter's] recommendation algorithm was using absolute block count, rather than percentile block count, causing accounts with many followers to be dumped, even if blocks were only 0.1% of followers."
And the engineering team are far from imbeciles because they built one of the worlds' best cache and RPC microservice components. As well as the fact that up until Musk took over the website was running just fine (other than your issue with product decisions).
-
Pretty incredible thread where Elon confuses how GraphQL works, thinks the Android client itself is making one thousand requests, and then publicly fires an employee who corrects him.
Bro it's their fucking project lolhttps://twitter.github.io/finagle/
You can even see it mentioned in Finagle's project, which is what Twitter uses https://twitter.github.io/finagle/
-
Elon Musk publicly feuding with and firing his developers on Twitter
RPC generally means server side calls, probably this https://twitter.github.io/finagle/, and XHR is not RPC.
-
You worked on it? Why is it slow then?
Twitter is a Scala shop and specifically uses Finagle - a homegrown RPC framework based on Apache Thrift. https://twitter.github.io/finagle/
-
At what point does an unstable company become a risk in your tech stack? (more Twitter fallout)
We use Twitter Finagle. Coupled with some other bits, we are running our company's most critical services on top of it. The announcement that 50% of Twitter's workforce is being let go has us seriously concerned that our core infrastructure will be running on unmaintained software.
What are some alternatives?
gRPC - The Java gRPC implementation. HTTP/2 based RPC
Concurrent Ruby - Modern concurrency tools including agents, futures, promises, thread pools, supervisors, and more. Inspired by Erlang, Clojure, Scala, Go, Java, JavaScript, and classic concurrency patterns.
EventMachine - EventMachine: fast, simple event-processing library for Ruby programs
Netty - Netty project - an event-driven asynchronous network application framework
OkHttp - Square’s meticulous HTTP client for the JVM, Android, and GraalVM.
Akka - Build highly concurrent, distributed, and resilient message-driven applications on the JVM
Polyphony - Fine-grained concurrency for Ruby
Celluloid - Actor-based concurrent object framework for Ruby
Finatra - Fast, testable, Scala services built on TwitterServer and Finagle
Lagom - Reactive Microservices for the JVM
Dubbo - The java implementation of Apache Dubbo. An RPC and microservice framework.
Async Http Client - Asynchronous Http and WebSocket Client library for Java