zim-requests
Want a new ZIM file? Propose ZIM content improvements or fixes? Here you are! (by openzim)
warc2zim
Command line tool to convert a file in the WARC format to a file in the ZIM format (by openzim)
zim-requests | warc2zim | |
---|---|---|
14 | 2 | |
32 | 33 | |
- | - | |
6.2 | 6.9 | |
about 1 month ago | 1 day ago | |
Python | ||
- | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zim-requests
Posts with mentions or reviews of zim-requests.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-08-30.
-
Biodiversity ZIM by Wikipedia
Well yes you can, but you will need to post the request at https://github.com/openzim/zim-requests/issues
-
Has anybody ever tried to download all of the MIT OpenCourseWare?
I see their content is under a CC-license, so it's fair game for Kiwix. Open a ticket at https://github.com/openzim/zim-requests/issues to have it added to the queue.
-
Kiwix is hiring a python dev to help build new scrapers
As for scrapers of interest, well there's always some maintenance needed on the existing ones if you need a warmup of sorts, and I wouldn't mind it if mwoffliner was also able to pick up on wikia/fandom websites. Other than that on our current wishlist there's also code.org, or even manuallibs.com if you are really bad at design (as the ticket explains we might want the content but not the website design).
-
Is there a way to download TV Tropes for offline browsing?
I see a request from last year, and seems there are/were throttling issues with it. There is currently a 1GB .zim file in the linked folder though.
-
How to create a ZIM collection?
To submit this to the kiwix library, your best option would probably to create an issue in the zim-requests github repo.
-
WikiHow and StackOverflow now available on the Library
Open a ticket at https://github.com/openzim/zim-requests/issues - if there's an off-the-shelf solution for the website you requested then it'll be added to the zimfarm/library.
-
Monday feature wishlist: what would you want to see on Kiwix as a priority?
Yo, you know you can request specific websites to be scraped at https://github.com/openzim/zim-requests/issues ?
-
Is there a quick way to turn a GitHub wiki into a zim?
I don't think that's possible as of yet but 1. There is a ticket for ReadtheDocs https://github.com/openzim/zim-requests/issues/446
-
Is there a Kiwix Translation file?
Not that I know, but you can ask for confirmation on r/kiwix or if you have a specific website in mind then file a request on the zim-requests github repository.
-
Other knowledge bases, libraries, encyclopedias besides Wikipedia because of censorship?
The help we need there is to have someone scout around the internets, list resources that are up for the taking (usually Creative Commons-licensed, in one flavour or another) and open a zim-request on github.
warc2zim
Posts with mentions or reviews of warc2zim.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-11-15.
-
Zim vs WARC ?
There are clearly similarities between the two, given that Kiwix put resources into making WARC content available in ZIM archives (i.e. Zimit-style ZIMs, created with the Zimit scraper and warc2zim backend). But as u/IMayBeABitShy said, the ZIM specification focuses on providing a highly compressed container that is readable on-the-fly (i.e. by decompressing only the needed content to show an article), whereas WARC, or rather the compressed version WACZ, is merely a zipped version of the WARC data (request headers and responses). It is also readable on-the-fly, but compression will not be as optimal as the zstandard compression used by modern ZIM archives.
-
Is there a quick way to turn a GitHub wiki into a zim?
Or, use the warcit tool on your collection of documents, and convert them to a warc archive, then use the warc2zim commandline tool to convert the WARC to a ZIM;
What are some alternatives?
When comparing zim-requests and warc2zim you can also consider the following projects:
zim-tools - Various ZIM command line tools
zimit - Make a ZIM file from any Web site and surf offline!
kiwix-js-pwa - Kiwix JS Offline Browser implemented as a Progressive Web App (PWA), and packaged as Electron, NWJS and UWP apps for Windows and Linux.