kaitai_struct_formats
polyfile
Our great sponsors
kaitai_struct_formats | polyfile | |
---|---|---|
3 | 2 | |
682 | 322 | |
0.7% | 0.9% | |
6.3 | 7.6 | |
12 days ago | 2 months ago | |
Kaitai Struct | Python | |
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kaitai_struct_formats
- Magika: AI powered fast and efficient file type identification
-
Fq: Jq for Binary Formats
Kaitai has a repository of binary formats[1] that can be used in visualizers or to auto-generate parsers.
[1] https://formats.kaitai.io/
-
Show HN: I am building a new Python library to read/write PDF files
This is tangential to your submission, but PDF is the file format I use for exercising any library that claims to be a declarative file format (ala https://github.com/kaitai-io/kaitai_struct_formats#readme )
polyfile
- Blind Spots: Automatically detecting ignored program inputs
-
Show HN: I am building a new Python library to read/write PDF files
Be careful with PDF! There are many ambiguities in the specification that are implemented differently between parsers, as well as implicitly accepted malformations that almost all parsers will silently accept without warning. It is very easy to accidentally produce so-called file format schizophrenia: When the same file is rendered differently between two parsers. For example, with PDF, what if you have a PDF object stream that has a length that doesn't agree with the position of its `endstream` token? What if you have a PDF dictionary with duplicate keys? Do you use the value of the first key or the second? What if you have two, valid PDFs concatenated one after the other? Do you render the first or the second? What if an object in the XREF table has an incorrect offset?
Shameless plug: I am one of the maintainers of PolyFile, which, among other things, can produce an interactive HTML hex editor with an annotated syntax tree for dozens of filetypes, including PDF. For PDF, it uses a dynamically instrumented version of the PDFminer parser. It sounds like it might satisfy your use case.
https://github.com/trailofbits/polyfile
What are some alternatives?
PyMuPDF - PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
pdfquery - A fast and friendly PDF scraping library.
polytracker - An LLVM-based instrumentation tool for universal taint tracking, dataflow analysis, and tracing.
cutter - Free and Open Source Reverse Engineering Platform powered by rizin
jqjq - jq implementation of jq
pdfplumber - Plumb a PDF for detailed information about each char, rectangle, line, et cetera — and easily extract text and tables.
i7j-rups - RUPS is an acronym for Reading and Updating PDF Syntax. RUPS is a tool built on top of iText® that allows you to look inside a PDF document and browse the different PDF objects and content streams.
pdfsyntax - A Python library to inspect and modify the internal structure of a PDF file
mupdf - mirrored from git://git.ghostscript.com/mupdf.git