Our great sponsors
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
> The speeds were just stunning to say the least at 15GB/s.
That is amazing. That is around DDR4-1866 speeds, and not far from DDR4-2666 (~21 GB/s). At those speeds I would happily work with dataframes sitting on the disk rather than in memory [1, 2]. Did you benchmark RAID 0 with less than four disks?
[1] R: https://github.com/xiaodaigh/disk.frame
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
- Do you code from memory? Or do you reference things?
- How can I read in only two columns from a massive 10+ GB tab file?
- Data cleaning/ analysis 100-200 million rows of data. Is this doable in R, or is there another program I should try instead?
- is it possible to have my enviroment objects and work with them on my local drive instead of RAM?
- Ask HN: Learning Maths from the Ground Up