Is there a way to load a large SAS7BDAT dataset into R efficiently with fair speed?

• vroom

  3 608 7.6 C++

  Fast reading of delimited files (by tidyverse)

  

You can use an `rds` file. You have to read it in then write it out though. If you care about speed, then just use `readr::write_rds`, which is similar to the base `saveRDS`, but with compression off, but the file size will be much larger. You can also use random access objects, such as `fst`: https://www.fstpackage.org/, but again, need to write it out. I tried a quick benchmark and `haven` is much faster than `sas7bdat` package. If it's in a plain text delimited file, you can also look into `vroom`: https://github.com/r-lib/vroom

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project