table-transformer VS ast-grep

Saw this last time but never played with it https://github.com/microsoft/table-transformer

Have you tried the SOTA on Table Detection and Extraction with out of the box model weights?

https://huggingface.co/blog/document-ai https://github.com/microsoft/table-transformer https://github.com/google-research/pix2struct https://github.com/PaddlePaddle/PaddleOCR/blob/release/2.6/ppstructure/table/README.md

GPU is at 100% although a bit spiky (dropping occasionally to 50%), I expect that to be normal? I use the same configuration as the authors, num_workers is set to 1 https://github.com/microsoft/table-transformer/blob/main/src/structure_config.json . Data is on a separate SSD, C-drive is a NVMe SSD

It's unclear what the superpowers would be? Video doesn't show anything I can't do with an IDE or decent code editor, and there I also have refactoring tools, metadata like indicators for usages that can be used for navigating and so on.

Reminds me of UML-like diagrams over relational databases, except that it's generated one piece at a time. In practice I generate diagrams showing cyclomatic complexity much more often, and for code exploration outside the IDE I'd use ast-grep.

https://ast-grep.github.io/

This article illustrates the usage of ast-grep, a tool designed to locate and substitute patterns in your codebase, towards easing your migration to React 19.

This looks great, thanks for building and sharing it.

Interested folks may also want to check out ast-grep:

https://github.com/ast-grep/ast-grep

ast-grep is a command-line tool that lets you search and transform code written in many programming languages using abstract syntax trees (ASTs). ASTs are data structures that capture the syntactic and semantic structure of source code. With ast-grep, you can write patterns as if you are writing ordinary code, and it will match all code that has the same syntactical structure. And if you need more power, you can use YAML, a rule system that allows you to write more sophisticated linting rules or code modifications.

I really like this - it means the tool is available to people with familiarity of any of those four distribution mechanisms.

You can also download pre-built binaries from their releases page: https://github.com/ast-grep/ast-grep/releases/tag/0.14.2

On top of that, they offer API bindings for it in three different languages:

- Rust (not yet stable): https://docs.rs/ast-grep-core/latest/ast_grep_core/

- JavaScript/TypeScript: https://ast-grep.github.io/guide/api-usage/js-api.html

- Python: https://ast-grep.github.io/guide/api-usage/py-api.html

It's rare to see a tool/library offer this depth of language support out of the box.