luajit2 VS MessagePack

And Neovim is using OpenResty's branch of Luajit

Yea, LuaJIT can get near C speeds, as far as I'm aware. You can read more here: https://luajit.org/luajit.html

I also found this gtihub repo, this one is using luaJIT a just in time lua compiler, i dont know if you have any python expirience but this one, but from what i understand luaJIT makes lua a language that can be compiled and run in your terminal, it aperently also has a comminty made package/library manager called cherry.

openresty's LuaJIT2 has, and makes, regular releases (the last one was less than a month ago), and closely tracks development, including the extensions beyond Lua 5.1.

There is also the openresty fork of luajit which Neovim can be built with and provides their own releases.

luajit.org said

Remember, bad C++ code will certainly be slower than good code written in an interpreted language! That being said, Lua is very fast, one of the fastest scripting languages. See this thread, which talks about LuaJit.

https://github.com/openresty/luajit2

It has a few extras but they agree with the original luajit authors opinion that not every 5.2 feature can be made in jit.

so appreciate such a detailed reply, thanks. btw, why did you choose tinylib/msgp from 4 available go-impls?

If you find you're running the serial connection at maximum speed and it's still not fast enough, try switching to a more compact binary encoding that has both Serde and Arduino implementations, like MsgPack... though I don't remember enough about its format off the top of my head to tell you the easiest way to put an unambiguous header on each packet/message to make the protocol self-synchronizing.

The information can be stored in a database or as files, serialized in a standard format and with a schema agreed with your Data Engineering team. Depending on your information and requirements, it can be as simple as CSV, XML or JSON, or Big Data formats such as Parquet, Avro, ORC, Arrow, or message serialization formats like Protocol Buffers, FlatBuffers, MessagePack, Thrift, or Cap'n Proto.

MessagePack Similar to JSONs, just more compact, although not as much as the ones above. Still, it's usefull to retain some readability in your messages.

I'll try that msgpack.org website.

First of all, you're comparing this to GSON and Kryo, how does it compare to Msgpack, fast-serialization, but also Elsa and I'm sure, many others? Are there any limitations and/or trade-offs?

Upvote for msgpack, one of the great undervalued message protocols available.

I have two suggestions Capnproto, MessagePack (those are only the two examples that came to mind first, i bet there are even one or two especially developed for rust). Both of these are better than json in nearly every way.

Encode messages as JSON or MessagePack.