logos
Create ridiculously fast Lexers (by maciejhirsz)
lexgen
A fully-featured lexer generator, implemented as a proc macro (by osa1)
Our great sponsors
logos | lexgen | |
---|---|---|
15 | 4 | |
2,627 | 60 | |
- | - | |
8.3 | 5.9 | |
21 days ago | 3 months ago | |
Rust | Rust | |
Apache License 2.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
logos
Posts with mentions or reviews of logos.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-11.
-
Beating the fastest lexer generator in Rust
This is mighty impressive! I've been trying to get some motivation for the mythical rewrite of the proc macro in Logos, and this might just do it for me :D. I'll have a proper look later today and see if any of your findings have something that can be generalized. Also really surprised to see aarch64 doing better than x86_64 since the latter is what I've been optimizing for!
-
Letlang — Roadblocks and how to overcome them - My programming language targeting Rust
Rust is a very nice langage for implementing compilers, and has a nice ecosystem for it (logos, rust-peg, lalrpop, astmaker -- this one is mine --, etc...).
-
loxcraft: a compiler, language server, and online playground for the Lox programming language
rust-langdev has a lot of libraries for building compilers in Rust. Perhaps you could use these to make your implementation easier, and revisit it later if you want to build things from scratch. I'd suggest logos for lexing, LALRPOP / chumsky for parsing, and rust-gc for garbage collection.
-
Logos 0.13 released
Thanks! For compile times you might find the CLI version that Andrew Hickman contributed useful, it's undocumented still mostly I fear but shouldn't be hard to use, see original PR: https://github.com/maciejhirsz/logos/pull/248
-
Should I revisit my choice to use nom?
For my lexer generation purposes, I tend to use https://github.com/maciejhirsz/logos, as it not only generates an easy to use lazy lexer, but the result is also exceptionally fast!
-
Position in rowan
Hi, I'm using rowan to create a parser and want to print more useful error messages with position in the text/file. I'm using logos (https://crates.io/crates/logos) to generate the lexer. Is there a way to get the starting and ending positions of a SyntaxToken? If not I thought of adding my own wrapper struct around the SyntaxTokens.
-
Hey Rustaceans! Got a question? Ask here (6/2023)!
Is there a way for a lexer created with the logos crate (https://crates.io/crates/logos) to get the starting and ending positions for the tokens?
-
Best resources for a rust interpreter?
I wouldn't recommend Logos at this point. This recent bug is quite nasty and seems easy to hit, and the maintainer is unresponsive. Last commit was half a year ago. At this point I consider Logos abandonware, though it would be great if its development continued, or if it were forked.
-
Alternatives for "blazingly fast"
logos uses "ridiculously fast".
- Compiler in Rust
lexgen
Posts with mentions or reviews of lexgen.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-06.
-
How are macros dealt with for incremental compilation?
Indeed this is the problem I'm having with my proc macro crates lexgen and parsegen. In the case of lexgen, the proc macro is actually quite fast for realistic inputs, but the compiler spends a lot of time checking and generated code with cargo check (which I suspect rust-analyzer also uses). In the case of parsegen the proc macro does some analyses and takes some time. In both cases I have to split my proc macro code (not the proc macros, the code that uses the proc macros) to separate crates so that they won't be recompiler/re-analyzed as I work on the code.
-
If you're not using a lexer generator for your compiler, why?
My lexer generator can handle unicode too. It's not too difficult to implement.
- A fully-featured lexer generator for Rust, implemented as a proc macro
What are some alternatives?
When comparing logos and lexgen you can also consider the following projects:
foundation.rust-lang.org - website for Rust Foundation
parsegen - An LR parser generator, implemented as a proc macro
schema-registry - Confluent Schema Registry for Kafka
clojurust - A proof of concept version of Clojure in Rust.
book - The Rust Programming Language
hush - Hush is a unix shell based on the Lua programming language
sonyflake-rs - 🃏 A distributed unique ID generator inspired by Twitter's Snowflake.
micro-mitten - You might not need your garbage collector
crafting-interpreters-rs - Crafting Interpreters in Rust
phpass - PHPass, the WordPress password hasher, re-implemented in rust