loadtxt

~60-300x faster than numpy.loadtxt (by saethlin)

Loadtxt Alternatives

Similar projects and alternatives to loadtxt

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better loadtxt alternative or higher similarity.

loadtxt reviews and mentions

Posts with mentions or reviews of loadtxt. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-09-11.
  • What libraries do you miss from other languages?
    29 projects | /r/rust | 11 Sep 2021
    It really depends on what part of Numpy you're using. You can easily leave Numpy's text parsing in the dust. And if you're doing element-wise operations on arrays, you can easily see 2-3x improvement with just numba.
  • Experience with heap bloat
    3 projects | /r/rust | 22 Jan 2021
    Amdahl's Law will catch up with you really fast as you add threads with this strategy, but it's simple and is amenable to formats where you may have a delimiter in the middle of a record. For situations where you need maximum scaling and don't have the possibility of delimiters scattered into records, you can use the strategy I used to implement a faster numpy.loadtxt: https://github.com/saethlin/loadtxt/blob/master/src/inner.rs#L84 The general idea is that you divide the file among thread boundaries by splitting it on byte boundaries, then seeking from that byte offset to the end of the next record. This gets you non-interleaved sections so there's no duplicate parsing.

Stats

Basic loadtxt repo stats
2
5
0.0
about 4 years ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com