Noob request: help optimize my text processing code

• bzip2-rs

  1 93 0.0 C

  libbz2 (bzip2 compression) bindings for Rust

I would considering using https://crates.io/crates/bzip2 - and stream the file in directly. I would have a parsing stage to convert the data into:

• flamegraph

  47 4,262 7.4 Rust

  Easy flamegraphs for Rust projects and everything else, without Perl or pipes <3 (by flamegraph-rs)

  

Try doing a flamegraph to see where you are getting bottlenecked and post reaults here. https://github.com/flamegraph-rs/flamegraph

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• r5

  2 262 8.3 Java

  Developed to power Conveyal's web-based interface for scenario planning and land-use/transport accessibility analysis, R5 is our routing engine for multimodal (transit/bike/walk/car) networks with a particular focus on public transit

  

Ah, they're the output of specialized software to calculate point-to-point travel times by routing along a street network. The input CSVs are large because of routing from many origins to many destinations, usually all US census blocks to all nearby census blocks.

Suggest a related project