Siddhi VS m2cgen

Hi, I'm building a realtime analysis solution for our domain oriented microservice backend. All domain emit events in kafka. I'm looking for a solution to ingest data in an OLAP database based on processing those events (enrichment, filtering etc.). I found https://siddhi.io/ which looks promising. Since the last release (2019) the product is now part of WSo2 solution. I'm also looking at https://www.benthos.dev/. I'm more interested in a declarative solution than code.

Check out: https://github.com/BayesWitnesses/m2cgen

Notice that I’m using random values to populate the Sentiment field. You might compute the values for your fields based on other fields or actually use an ML model to perform the transformation. E.g. you could make use of m2cgen to transform trained models to pure python code and load them in **RedisGears **to be executed in a *GearsBuilder *instance. Another option is to pull out the big guns and go straight to RedisAI.

I wish that it was more common for model outputs to be converted the way bayeswitness does with mc2gen https://github.com/BayesWitnesses/m2cgen

And that’s it! All the magic in just two lines of code. I would like to thank the authors of the m2cgen library and encourage you to try it out.

I forgot to update the README. We just replaced RNN with xgboost that has a better f1 and is very quick, as the decision trees are translated to plain rust using m2cgen.

Probably, as many frameworks come with a Rust support (or there are wrappers). Some models, like decision tree, can also be automatically translated to plain Rust (in my company we use m2cgen to translate xgboost models to plain rust code).

These repositories on GitHub are good start I think: https://github.com/BayesWitnesses/m2cgen and https://github.com/vickylance/dart_nn