awesome-datahoarding
SingleFile
Our great sponsors
| awesome-datahoarding | SingleFile | |
|---|---|---|
| 6 | 94 | |
| 1,005 | 13,673 | |
| - | - | |
| 4.9 | 9.7 | |
| 8 months ago | 9 days ago | |
| JavaScript | ||
| - | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-datahoarding
-
All my life was a bloody lecher. Now I have a VPN and wanna pay you all back - but how?
maybe you can check at this sub or this github.
- Ask HN: Looking for a great tool to archive websites
-
need some guidance
Welcome! You are clearly in the right place. If I can give any advice, it would be to take a look at these two links: Awesome-DataHoarding and the wiki of this subreddit. I wish I had both of these resources when I started.
-
How to get started?
i have some stuff in mind, but i'm looking for tools to download it. I found a list https://github.com/simon987/awesome-datahoarding so that answers my own question, mostly. I'm just looking for some tips on how to store my data now.
-
Looking for open source software to scrape webpages but also make them searchable with a webui. (locally hosted)
You might also be interested in this list, those alternatives listed are really great and better, some support the WARC format (that my program doesn't).
- Trying to find a Github containing list of tool projects for backing up (discord, other places)
SingleFile
-
How SingleFile Transformed My Obsidian Workflow
That's interesting. I have been saving articles as PDF files, which is browser-independent, but useful just for search and reference, a nuisance to quote/copy-and-paste.
If I search only the computer, I don't get results from EBay and Amazon at the top. The idea of keeping the knowledge base separate from the primary notes is a good idea. In my case, that knowledge base is the file system, and the primary notes are whatever I choose.
When I was using Evernote, the inbox was the knowledge base and notebooks were the focus. I just had too many different potential projects going on to manage this well.
Looking to focus.
I'll revisit Firefox and SingleFile.
Explanation of the zip file inside.
https://github.com/gildas-lormeau/SingleFile/blob/master/faq...
-
Webpage is also a PNG file and a ZIP file
[2] https://github.com/gildas-lormeau/SingleFile/blob/master/faq...
-
My website is one binary
I agree it would be "great" a complete website in the ZIP. I think this is technically possible, someone just have to code it.
[1] https://github.com/gildas-lormeau/SingleFile#singlefile
-
Omnivore – free, open source, read-it-later App
Singlefile [1] works pretty well for me for that use case.
It has the added advantage that the file format is just plain HTML, and together with “reader mode” in most browsers, it’s a great way to save long-form text or other mostly static pages for later reference.
It obviously doesn’t work for very dynamic pages, let alone web apps.
[1] https://github.com/gildas-lormeau/SingleFile
-
Pocket: It gets worse the more you use it
I’ve tried all the third party services for archiving interesting things over the years but nothing beats saving everything to your local filesystem using [SingleFile](https://github.com/gildas-lormeau/SingleFile) and using a full-text search front over the directory (something like Houdahspot, for example).
- 11. 使用浏览器插件保存完整网页
-
How to easily and quickly save all my subbreddit's wikis?
If you want to save them as a file locally you could use something like SingleFile. You could also put the URL for each wiki into archive.org's Save Page Now so that anyone can access it. Either way, without scripting, you'll have to do some manual labor to get the URL for each wiki.
- Save webpages into Obsidian (mobile)
- Wayback: Self-hosted archiving service integrated with Internet Archive
-
Ask HN: Looking for a great tool to archive websites
For small numbers of pages, the SingleFile[0] extension for Firefox (WebExtension) is pretty handy. It's not "archival quality", though, if that's the kind of "archiving" you're doing.
[0] https://github.com/gildas-lormeau/SingleFile
What are some alternatives?
grab-site - The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
leetcode-rating-predictor - Leetcode Rating Predictor built with Node. Browser extension and web interface.
Collect - A server to collect & archive websites that also supports video downloads
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
page-ruler-redux - An awesome page ruler extension for google chrome
monolith - ⬛️ CLI tool for saving complete web pages as a single HTML file
sidebery - Firefox extension for managing tabs and bookmarks in sidebar.
headless-recorder - Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.
SnappySnippet - Chrome extension that allows easy extraction of CSS and HTML from selected element.
webscrapbook - A browser extension that captures web pages to local device or backend server for future retrieval, organization, annotation, and edit. This project inherits from legacy Firefox add-on ScrapBook X.
stream-detector - A Firefox addon for keeping track of manifests used by various streaming protocols and downloading media files.
FoxyRecon - A Firefox add-on for OSINT investigations