-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
This is interesting, I'd like to see how fast it runs. A challenge even with fast implementations of models is there is always some overhead starting up.
I also want to mention this is exactly the kind of use case I had in mind for Ferrite, a dependency free Fortran implementation of sentence transformers: https://github.com/rbitr/ferrite The idea is a very simple script to run transformer inference on a CPU that can be incorporated into a project without pulling in a million dependencies.
I am happy to see though that this is a C++ project and appears not to require pytorch and HF transformers to use!