Our great sponsors
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
It depends on your hardware, but it should not be a problem. You might look into disk frame (https://diskframe.com) or similar packages.
Yes, data.table can handle this. But your limiting factor might be RAM. This benckmark shows that data.table can load in RAM a billion rows (9 columns) faster than other solutions. (Source). They run their benchmark on a machine with 50 GB of RAM.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
- Do you code from memory? Or do you reference things?
- How can I read in only two columns from a massive 10+ GB tab file?
- is it possible to have my enviroment objects and work with them on my local drive instead of RAM?
- We Test PCIe 4.0 Storage: The AnandTech 2021 SSD Benchmark Suite
- Ask HN: Learning Maths from the Ground Up