zim-requests
zim-tools
zim-requests | zim-tools | |
---|---|---|
14 | 4 | |
32 | 110 | |
- | 0.9% | |
6.2 | 7.9 | |
about 1 month ago | 5 days ago | |
C++ | ||
- | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zim-requests
-
Biodiversity ZIM by Wikipedia
Well yes you can, but you will need to post the request at https://github.com/openzim/zim-requests/issues
-
Has anybody ever tried to download all of the MIT OpenCourseWare?
I see their content is under a CC-license, so it's fair game for Kiwix. Open a ticket at https://github.com/openzim/zim-requests/issues to have it added to the queue.
-
Kiwix is hiring a python dev to help build new scrapers
As for scrapers of interest, well there's always some maintenance needed on the existing ones if you need a warmup of sorts, and I wouldn't mind it if mwoffliner was also able to pick up on wikia/fandom websites. Other than that on our current wishlist there's also code.org, or even manuallibs.com if you are really bad at design (as the ticket explains we might want the content but not the website design).
-
Is there a way to download TV Tropes for offline browsing?
I see a request from last year, and seems there are/were throttling issues with it. There is currently a 1GB .zim file in the linked folder though.
-
How to create a ZIM collection?
To submit this to the kiwix library, your best option would probably to create an issue in the zim-requests github repo.
-
WikiHow and StackOverflow now available on the Library
Open a ticket at https://github.com/openzim/zim-requests/issues - if there's an off-the-shelf solution for the website you requested then it'll be added to the zimfarm/library.
-
Monday feature wishlist: what would you want to see on Kiwix as a priority?
Yo, you know you can request specific websites to be scraped at https://github.com/openzim/zim-requests/issues ?
-
Is there a quick way to turn a GitHub wiki into a zim?
I don't think that's possible as of yet but 1. There is a ticket for ReadtheDocs https://github.com/openzim/zim-requests/issues/446
-
Is there a Kiwix Translation file?
Not that I know, but you can ask for confirmation on r/kiwix or if you have a specific website in mind then file a request on the zim-requests github repository.
-
Other knowledge bases, libraries, encyclopedias besides Wikipedia because of censorship?
The help we need there is to have someone scout around the internets, list resources that are up for the taking (usually Creative Commons-licensed, in one flavour or another) and open a zim-request on github.
zim-tools
- Trying to Install wget-2-zim on Linux Mint 18.1
-
How to Download All of Wikipedia onto a USB Flash Drive
It looks like Kiwix uses the ZIM file format, which appears to have diffing support [0] (see zimdiff and zimpatch). That said, it doesn't look like Kiwix actually publishes those diffs.
[0] https://github.com/openzim/zim-tools/tree/master/src
-
I found a way to read the pali canon offline on my smartphone, for free
One problem that remains is to bring the access to insight webpage to the ".zim" format that the kiwix app can process. Here it seems the only way to do that is a tool called "zimwriterfs" that can be found in another opensource project that defines the basis of the offline reader format and is used by kiwix I believe. https://github.com/openzim/zim-tools ...this was no problem for me, as the tool can be accessed easily from standard linux distributions like ubuntu. Creating the .zim file from the unzipped access to insight offline version is a single command line, after preparing a little icon that will be used for the site in kiwix. There seems to be no windows version of that tool available though...
-
Zim-Tools 3.0.0 is out!
More info at https://github.com/openzim/zim-tools
What are some alternatives?
kiwix-js-pwa - Kiwix JS Offline Browser implemented as a Progressive Web App (PWA), and packaged as Electron, NWJS and UWP apps for Windows and Linux.
kiwix-tools - Command line Kiwix tools: kiwix-serve, kiwix-manage, ...
warc2zim - Command line tool to convert a file in the WARC format to a file in the ZIM format
libzim - Reference implementation of the ZIM specification
F3D - Fast and minimalist 3D viewer.
wiktextract - Wiktionary dump file parser and multilingual data extractor
browsertrix-crawler - Run a high-fidelity browser-based crawler in a single Docker container
ledger - Double-entry accounting system with a command-line reporting interface
replayweb.page - Serverless replay of web archives directly in the browser
ZIMply - An easy to use offline reader for ZIM files right in your browser!
wget-2-zim - creates ZIM files for Kiwix from arbitrary websites with wget and some nifty tricks (doesn't need ServiceWorkers)
awesome-web-archiving - An Awesome List for getting started with web archiving