eRPC
areg-sdk
eRPC | areg-sdk | |
---|---|---|
2 | 21 | |
824 | 239 | |
1.0% | - | |
4.6 | 8.6 | |
22 days ago | about 1 month ago | |
C++ | C++ | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
eRPC
-
Are You Sure You Want to Use MMAP in Your Database Management System?
The most common example is DPDK [1]. It's a framework for building bespoke networking stacks that are usable from userspace, without involving the kernel.
You'll find DPDK mentioned a lot in the networking/HPC/data center literature. An example of a backend framework that uses DPDK is the seastar framework [2]. Also, I recently stumbled upon a paper for efficient RPC networks in data centers [3].
If you want to learn more, the p99 conference by ScyllaDB has tons of speakers talking about some interesting challenges.
[1] https://www.dpdk.org/.
[2] https://github.com/scylladb/seastar
[3] https://github.com/erpc-io/eRPC
-
Zero-copy network transmission with io_uring
My side project has been to rewrite https://github.com/erpc-io/eRPC which does RPCs over UDP with some congestion control supposedly quite fast. Paper: https://www.usenix.org/system/files/nsdi19-kalia.pdf. I never got the code to work in AWS; I believe the author focused on Mellanox NICS but that's not really commodity H/W, which is where my interests lay.
So I dug into it .. and well I'll have my own library soon. I should be able to send UDP w/o congestion control sometime this week.
eRPC uses DPDK (100% user space NIC TX/RX control) plus the author's own other ideas to get performance. Since I'm getting into NICs + DPDK (in a serious way i.e this much more involved than vanilla sys/socket.h I/O) way, way late in the game, I hope and believe DPDK is, in the medium term, the better way to go than to turn to kernel improvements in for I/O.
Like others, getting the kernel out of the way, with pinned threads seems cleaner if one can develop from scratch.
This library will be a part of something bigger, however, a key architecture point for many people is: I got a RPC/packet/message. Now should I:
* process it in-place e.g. on the thread that was doing RX?
* delegate it to another core?
* if I delegate .. to whom?
* If I delegate how do I get a response back?
In DPDK I believe these are easier to decide and well-manage in code.
areg-sdk
-
Essentials of Object Oriented and Functional Programming: A Guide to Modular Code
FP Libraries: gRPC, ZeroMQ, and AREG are examples of libraries with a special focus on providing possibilities for Interprocess Communication. Developed using C++, they facilitate communication through predefined APIs, emphasizing functional programming concepts.
-
How to find a suitable topic at GitHub to contribute?
In addition, if the owners of the repositories add more relevant and precise labels to the issues, it increases the possibility that the OSS developers find the issues they would loved to resolve. For example, the issues of AREG SDK which marked "help wanted" in addition have such labels like "C++" or "cmake", "unit test", etc.
-
Makefile versus CMake build system
My closer introduction with these 2 tools started from OSS areg sdk project. Because of some experienced friend recommendation, i started with make. The main reason was that it is more spread in embedded. No other weighty argument they had. After having make, i decided to integrate cmake. Suddenly i figured out that cmake for me is more understandable and powerful. It already has many features that makes things easier. The biggest advantage for me is that in comparison to make / Makefile, lot of IDE support build with cmake. The cross-platform / cross-compile for areg-sdk is important feature, and this is easier to achieve with cmake. For example, I can compile with make under Linux with gcc/clang, but under windows can compile in cygwin environment and not with MSVC, which is not the issue in case of cmake.
-
Your fun software projects
Project: AREG is a cross-platform interface-centric lightweight communication engine, which forms a grid of services in the IoT fog- and mist-network, automates the real-time transmission of data between multiple connected software nodes, so that the connected Things interact like a thin distributed servers and clients. Technologies: C/C++17, standard library dependencies, POSIX and Win32 API. Can be used in real product.
-
How abut open source projects?
Nice. I also have own project, but it already requires much time, so that cannot join in other projects. As well, up to now have no dependencies, except standard system libraries. I think, we should have a separate post to share projects and give short description. Some might be interested to join.
- Cross-platform IPC engine that automates real-time data transmission between connected processes, allowing them to interact like a distributed services
- Distributed services programming for Embedded, IoT edge and desktop applications
- Interface-centric Object RPC (ORPC) engine for embedded and desktop
-
ncurses and POSIX
Here I've crated a list of API that use in the project. Some of methods are part of ncurses.h. So I have a questions: