vscode-textmate VS usfm-grammar

Luckily, there is a project that has fitted my needs perfectly: vscode-grammar-test. It’s a command line tool that builds on the VS Code regex engine and grammar file parser and allows to run unit tests directly against a given grammar file.

Shiki does this because the underlying library vscode-textmate or vscode-oniguruma returns black if the value is not a valid color. This explains why Code Hike uses blackish color codes instead of variables. But what if we write a variable directly into the theme instead of the color code.

Thank you for the response! I feared that I might have to create a vscode extension for the language. I'm assuming I can use this json file to build textmate grammar for Stks ? Do you suggest any specific resources for learning textmate grammar and regex? I'm especially unfamiliar with regex. Thanks again

I see now. Thanks for the hint!

There are lots of different approaches you could take. For sourcecodeshots, I run it through VSCode's tokenizer (https://github.com/microsoft/vscode-textmate) and then use node-canvas to generate the image one line at a time.

It's a very imperative process and fairly slow on a cpu, but the nice thing is that I can run the same code in the browser to speed up development. The Rust project, https://github.com/Aloxaf/silicon, mentioned in another part of the comments is probably faster, but I didn't find it when I was searching for a solution.

This is an example of a library we built using Ohm: https://github.com/Bridgeconn/usfm-grammar [1]

It works great for our use-case though I have been eyeing tree-sitter[2] for its ability to do partial parses.

[1] USFM: https://ubsicap.github.io/usfm/