picohttpparser VS onload

Yea, it is definitely a fake HTTP server which I acknowledge in the article [1]. However based on the size of the requests, and my observation of the number of packets per second being symmetrical at the network interface level, I didn't have a concern about doubled responses.

Skipping the parsing of the HTTP requests definitely gives a performance boost, but for this comparison both sides got the same boost, so I didn't mind being less strict. Seastar's HTTP parser was being finicky, so I chose the easy route and just removed it from the equation.

For reference though, in my previous post[2] libreactor was able to hit 1.2M req/s while fully parsing the HTTP requests using picohttpparser[3]. But that is still a very simple and highly optimized implementation. From what I recall when I played with disabling HTTP parsing in libreactor I got a performance boost of about 5%.

1. https://talawah.io/blog/linux-kernel-vs-dpdk-http-performanc...

2. https://talawah.io/blog/extreme-http-performance-tuning-one-...

3. https://github.com/h2o/picohttpparser

Just-js is not nodejs framework. It's sperate runtime and most of the http code is written using c/c++ (for example headers parsing logic is written using c and is using https://github.com/h2o/picohttpparser which is c library)

Other than that, I heard there's some 3rd party network libraries that are generally considered lower latency, one of them I believe either redhat uses for one of their systems, or it is sponsored by them: https://github.com/Xilinx-CNS/onload

I mean really you want to be doing some kind of (kernel network bypass with some sort of system programming language like C++ for low latency trading systems like this. Arb trading is usually not worth it unless you have a ton of expertise or some crazy mathematical edge that can offset. Plus you need to be guaranteed to execute the trade you ask for which most average joes don't have.

How about the x2 series from Xilinx?

It comes from solarflare who have a long pedigree of low-latency smartnics. They used to supply Cloudflare, and also supply like 50% of fintechs/financial markets.

You can also just use openonload to accelerate your programs. In this case just doing straight linux socket programming, which can be accelerated without dpdk. Or just use the generic linux driver if necessary.

https://github.com/Xilinx-CNS/onload

Ahki SingHania - Akhi is the engineering manager for the Execution team. He has a background in operating systems and networking. Before working on the Internet Computer, he worked on OpenOnload and Barrelfish.

https://github.com/Xilinx-CNS/onload any good?

It used to be openonload.org which seems to redirect to https://github.com/Xilinx-CNS/onload for the source to onload.