zim-requests VS zim-tools

Well yes you can, but you will need to post the request at https://github.com/openzim/zim-requests/issues

I see their content is under a CC-license, so it's fair game for Kiwix. Open a ticket at https://github.com/openzim/zim-requests/issues to have it added to the queue.

As for scrapers of interest, well there's always some maintenance needed on the existing ones if you need a warmup of sorts, and I wouldn't mind it if mwoffliner was also able to pick up on wikia/fandom websites. Other than that on our current wishlist there's also code.org, or even manuallibs.com if you are really bad at design (as the ticket explains we might want the content but not the website design).

I see a request from last year, and seems there are/were throttling issues with it. There is currently a 1GB .zim file in the linked folder though.

To submit this to the kiwix library, your best option would probably to create an issue in the zim-requests github repo.

Open a ticket at https://github.com/openzim/zim-requests/issues - if there's an off-the-shelf solution for the website you requested then it'll be added to the zimfarm/library.

Yo, you know you can request specific websites to be scraped at https://github.com/openzim/zim-requests/issues ?

I don't think that's possible as of yet but 1. There is a ticket for ReadtheDocs https://github.com/openzim/zim-requests/issues/446

Not that I know, but you can ask for confirmation on r/kiwix or if you have a specific website in mind then file a request on the zim-requests github repository.

The help we need there is to have someone scout around the internets, list resources that are up for the taking (usually Creative Commons-licensed, in one flavour or another) and open a zim-request on github.

It looks like Kiwix uses the ZIM file format, which appears to have diffing support [0] (see zimdiff and zimpatch). That said, it doesn't look like Kiwix actually publishes those diffs.

[0] https://github.com/openzim/zim-tools/tree/master/src

One problem that remains is to bring the access to insight webpage to the ".zim" format that the kiwix app can process. Here it seems the only way to do that is a tool called "zimwriterfs" that can be found in another opensource project that defines the basis of the offline reader format and is used by kiwix I believe. https://github.com/openzim/zim-tools ...this was no problem for me, as the tool can be accessed easily from standard linux distributions like ubuntu. Creating the .zim file from the unzipped access to insight offline version is a single command line, after preparing a little icon that will be used for the site in kiwix. There seems to be no windows version of that tool available though...

More info at https://github.com/openzim/zim-tools