warc-parquet
🗄️ A simple CLI for converting WARC to Parquet. (by maxcountryman)
WarcDB
WarcDB: Web crawl data as SQLite databases. (by Florents-Tselai)
| warc-parquet | WarcDB | |
|---|---|---|
| 4 | 7 | |
| 99 | 383 | |
| - | - | |
| 6.8 | 7.2 | |
| 3 days ago | 2 months ago | |
| Rust | Python | |
| - | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
warc-parquet
Posts with mentions or reviews of warc-parquet.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-06-24.
WarcDB
Posts with mentions or reviews of WarcDB.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-01-29.
What are some alternatives?
When comparing warc-parquet and WarcDB you can also consider the following projects:
sqlite-parquet-vtable - A SQLite vtable extension to read Parquet files
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
q - q - Run SQL directly on delimited files and multi-file sqlite databases
WARCTools - A list of tools related to W(eb)ARC(hive)