Rust vs Go Issue

• rudex

  3 0 3.0 Rust

Try using rayon: https://github.com/Cybergenik/rudex/pull/1 . Rayon handles thread pools, and work stealing etc, so you'll end up with running just the right number of threads according to your workload and machine.

• godex

  1 2 3.7 Go

  Go filesystem traverser (by Cybergenik)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ants

  8 12,070 7.1 Go

  🐜🐜🐜 ants is a high-performance and low-cost goroutine pool in Go./ ants 是一个高性能且低损耗的 goroutine 池。

I remember doing something similar to OP recently. Goroutines also incur a bit of overhead (have to be GC'd and so on), and the same worker pool technique can be applied to them in much the same way, as seen in popular libraries like https://github.com/panjf2000/ants

• dust

  48 7,780 7.5 Rust

  A more intuitive version of du in rust

The first thought I had was to use rayon for this. And looking at some prior art that does pretty much the exact same thing, it does indeed use rayon.

• ripgrep

  348 44,901 9.3 Rust

  ripgrep recursively searches directories for a regex pattern while respecting your gitignore

Looking at some more prior art, you can write your own parallel visitor and customize the number of threads to run.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project