simdutf8
SIMD-accelerated UTF-8 validation for Rust. (by rusticstuff)
reference
The Rust Reference (by rust-lang)
| simdutf8 | reference | |
|---|---|---|
| 15 | 22 | |
| 509 | 1,140 | |
| 0.8% | 1.8% | |
| 1.2 | 8.8 | |
| 17 days ago | 9 days ago | |
| Rust | Rust | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
simdutf8
Posts with mentions or reviews of simdutf8.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-08-05.
-
simdutf: Unicode validation and transcoding at billions of characters per second
That's not enough to make it interesting. There's already a porting of it in rust (https://github.com/rusticstuff/simdutf8), and inclusion in the stdlib has already been discussed: the problem is that you can't use simd in all supported targets and conditional compilation/detection is also very tricky.
-
Making Rust Float Parsing Fast: libcore Edition
No, libcore uses simple branching code at the moment, see https://github.com/rust-lang/rust/issues/68455. The issue is still actively being worked on. Note, it's not a simple drop in, and there seem to be even faster algorithms. For now there is https://github.com/rusticstuff/simdutf8.
-
What's everyone working on this week (19/2021)?
I will work on simdutf8, either
- simdutf8 v0.1.2 - Apple Silicon can get very fast UTF-8 validation too
-
simdutf v0.1.1 - A small step for semver, one giant leap for performance.
Now I have to benchmark again, it might be negligable. See also the discussion for this pull request.
-
Show HN: High-speed UTF-8 validation in Rust
Check the benchmarks section (https://github.com/rusticstuff/simdutf8#Benchmarks), second table. simdutf8 is up to 28 % faster on my Comet Lake CPU. However with pure ASCII clang does something magical with simdjson and it beats my implementation by a lot. GCC-compiled simdjson is slower all around except for a few outliers with short byte sequences.
The algorithm is the one from simdjson, the main difference is that it uses an extra step in the beginning to align reads to the SIMD block size.
- High-speed UTF-8 validation in Rust
reference
Posts with mentions or reviews of reference.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-28.
-
Why is there no standard way of removing the mutability property from a reference?
Is perfectly valid Rust code. And there's reborrow, too.
-
Let's thank who have helped us in the Rust Community together!
I truly appreciate how much effort u/ehuss puts into maintaining The Rust Reference, considering that documenting stuff is not usually a fun task people want to do. Not to mention that ehuss is also the Cargo team lead, responsible for developing one of the most loved tools in Rust. ehuss's insightful knowledge always ensures that Cargo works without unexpected surprises.
-
noob question about moving references
Here is (somewhat long) discussion on the topic with other examples: https://github.com/rust-lang/reference/issues/788
-
Announcing Rust 1.66.0
The PR for updating the documentation is here, still under discussion: https://github.com/rust-lang/reference/pull/1055
-
Can someone please explain this to me? How does the compiler know about this for more advanced cases and when does it do this?
thank you this is definitely interesting and i need to read more. For anyone else, this is the thing I found about this issue when I looked it up. It's a github issue about how little documentation there is on the subject and that there should be more. Even the initial post has a lot of interesting details and links. Thanks for bringing it up although sorry it seems your comment went a bit over the heads of some redditors.
-
Anything C can do Rust can do Better
⭐ The Rust Reference - repo
-
GAT section in new version of Rust book?
For the rust reference, there is an open pull request https://github.com/rust-lang/reference/pull/1265/
-
Hey Rustaceans! Got a question? Ask here! (33/2022)!
&mut * is reborrowing which is allowed
-
Why is rust so difficult to learn?
Officialhttps://www.youtube.com/watch?v=rAl-9HwD858&list=PLqbS7AVVErFiWDOAVrPt7aYmnuuOLYvOa The official rust book Rust by example The rust docs Rustlings the most fun way imo
-
PSA - Most Rust tooling runs only on the default feature set and current platform if no special steps are taken
I've opened a PR to add this more prominently to the Conditional Compilation entry in the Rust reference.
What are some alternatives?
When comparing simdutf8 and reference you can also consider the following projects:
sqloxide - Python bindings for sqlparser-rs
rust-by-example - Learn Rust with examples (Live code editor included)
simdutf - Unicode routines (UTF8, UTF16, UTF32) and Base64: billions of characters per second using SSE2, AVX2, NEON, AVX-512, RISC-V Vector Extension. Part of Node.js and Bun.
mrustc - Alternative rust compiler (re-implementation)
cxx - Safe interop between Rust and C++
tour_of_rust - A tour of rust's language features
encoding_rs - A Gecko-oriented implementation of the Encoding Standard in Rust
stdarch - Rust's standard library vendor-specific APIs and run-time feature detection
bumpalo - A fast bump allocation arena for Rust
utils - Utility crates used in RustCrypto
fast_float - Fast and exact implementation of the C++ from_chars functions for number types: 4x to 10x faster than strtod, part of GCC 12 and WebKit/Safari
rust - Rust for the xtensa architecture. Built in targets for the ESP32 and ESP8266