c-questdb-client
lfbb
Our great sponsors
| c-questdb-client | lfbb | |
|---|---|---|
| 2 | 10 | |
| 39 | 56 | |
| - | - | |
| 6.6 | 6.2 | |
| 16 days ago | about 1 month ago | |
| C++ | C++ | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
c-questdb-client
-
Inserting 1.8M Rows/S from Pandas into QuestDB with Arrow, Rust and Cython
Hi, I'm the original author of the QuestDB Python client library and benchmark.
It all started when we had one of our users needing to insert quite a bit of data into our database quickly from Pandas. They had a dataframe that took 25 minutes to serialize row-by-row iterating through the dataframe. The culprit was .iterrows(). Now it's a handful of seconds.
This took a few iterations: At first I thought this could all be handled by Python buffer protocol, but that turned out to create a whole bunch of copies, so for a number of dtypes the code now uses Arrow when it's zero-copy.
The main code is in Cython (and the fact that one can inspect the generated C is pretty neat) with supporting code in Rust. The main serialization logic is in Rust and it's in a separate repo: https://github.com/questdb/c-questdb-client/tree/main/questd....
-
Inserting 1.1M rows/s from Pandas into QuestDB with Arrow, Rust & Cython
The main code is in Cython (and the fact that one can inspect the generated C is pretty neat) with auxilliary code in Rust. The main serialization logic is in Rust and it's in a separate repo: https://github.com/questdb/c-questdb-client/tree/main/questdb-rs.
lfbb
- A lock-free ring-buffer with contiguous reservations (2019)
-
OpenPicoRTOS: 'cause the world DEFINITELY needs another RTOS !
If you're interested in how to do that you can check out a library of mine: https://github.com/DNedic/lfbb (although you don't need to bother with memory ordering if you don't want, you can just use the sequential consistency model).
-
How do you handle data coupling between RTOS tasks?
You might be interested to take a look at this if efficiency is one of your goals: https://github.com/DNedic/lfbb
-
Library for generic ringbuffer that can be filled via DMA?
I have exactly what you are looking for https://github.com/DNedic/lfbb
-
Best practices on loosely coupling the high-level modules on a sensor-packager-transmitter embedded c device.
I don't see a reason SensorCollector should send a flag when there is enough data to send, the circular buffer object should be able to tell you when there is enough data to send and it should not be coupled to your specific applicaton. For situations where you want the data to always be contigous and need a general purpose circular buffer, you can take a look at a library i wrote: https://github.com/DNedic/lfbb
- LFBB – A Lock Free Bipartite Buffer Library Written in Standard C11
-
Best practice for preventing data collisions between ISR and non ISR code without turning off interrupts? (FreeRTOS)
If you need something more advanced, check this out: https://github.com/DNedic/lfbb
- A Lock Free Bipartite Buffer Library Written in Standard C11
- Lock Free Bipartite Buffer Library Written in Standard C11
- A Lock Free Bipartite Buffer library written in standard C11
What are some alternatives?
py-tsbs-benchmark - Benchmark ingestion of the TSBS "dev ops" dataset into QuestDB via ILP using the `questdb` Python library and Pandas.
lwrb - Lightweight generic ring buffer manager library
nanoprintf - The smallest public printf implementation for its feature set.
fifo_map - a FIFO-ordered associative container for C++
Vitis-Tutorials - Vitis In-Depth Tutorials
muon - GPU based Electron on a diet
OpenPicoRTOS - Very small, safe, lightning fast, yet portable preemptive RTOS with SMP support
fprime - F´ - A flight software and embedded systems framework
Ring-Buffer - A simple ring buffer (circular buffer) designed for embedded systems.
ringbuf - An STL-like ring buffer for C++11.
vista - Fixed-capacity in-place container spans