snapcrawl
SingleFile
snapcrawl | SingleFile | |
---|---|---|
3 | 94 | |
54 | 13,778 | |
- | - | |
5.0 | 9.6 | |
10 months ago | 5 days ago | |
Ruby | JavaScript | |
MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
snapcrawl
-
Selfhosted service to screenshot websites - but I'm not finding the options I need
A quick search turned up snapcrawl. It seems it could do what you're asking? I'm not sure how you feed it a file with a list of URLs, but I'm sure it's possible.
-
Screenshots. Trying to grab a whole site.
I did a quick search and found this library.
-
ANYONE KNOW HOW TO SCREENSHOT MULTIPLE PAGES ON A WEBSITE AUTOMATICALLY?
I googled "webpage crawler to screenshot" and got this: https://github.com/DannyBen/snapcrawl
SingleFile
-
How SingleFile Transformed My Obsidian Workflow
That's interesting. I have been saving articles as PDF files, which is browser-independent, but useful just for search and reference, a nuisance to quote/copy-and-paste.
If I search only the computer, I don't get results from EBay and Amazon at the top. The idea of keeping the knowledge base separate from the primary notes is a good idea. In my case, that knowledge base is the file system, and the primary notes are whatever I choose.
When I was using Evernote, the inbox was the knowledge base and notebooks were the focus. I just had too many different potential projects going on to manage this well.
Looking to focus.
I'll revisit Firefox and SingleFile.
Explanation of the zip file inside.
https://github.com/gildas-lormeau/SingleFile/blob/master/faq...
-
Webpage is also a PNG file and a ZIP file
[2] https://github.com/gildas-lormeau/SingleFile/blob/master/faq...
-
My website is one binary
I agree it would be "great" a complete website in the ZIP. I think this is technically possible, someone just have to code it.
[1] https://github.com/gildas-lormeau/SingleFile#singlefile
-
Omnivore – free, open source, read-it-later App
Singlefile [1] works pretty well for me for that use case.
It has the added advantage that the file format is just plain HTML, and together with “reader mode” in most browsers, it’s a great way to save long-form text or other mostly static pages for later reference.
It obviously doesn’t work for very dynamic pages, let alone web apps.
[1] https://github.com/gildas-lormeau/SingleFile
-
Pocket: It gets worse the more you use it
I’ve tried all the third party services for archiving interesting things over the years but nothing beats saving everything to your local filesystem using [SingleFile](https://github.com/gildas-lormeau/SingleFile) and using a full-text search front over the directory (something like Houdahspot, for example).
- 11. 使用浏览器插件保存完整网页
-
How to easily and quickly save all my subbreddit's wikis?
If you want to save them as a file locally you could use something like SingleFile. You could also put the URL for each wiki into archive.org's Save Page Now so that anyone can access it. Either way, without scripting, you'll have to do some manual labor to get the URL for each wiki.
- Save webpages into Obsidian (mobile)
- Wayback: Self-hosted archiving service integrated with Internet Archive
-
Ask HN: Looking for a great tool to archive websites
For small numbers of pages, the SingleFile[0] extension for Firefox (WebExtension) is pretty handy. It's not "archival quality", though, if that's the kind of "archiving" you're doing.
[0] https://github.com/gildas-lormeau/SingleFile
What are some alternatives?
colorize - Ruby string class extension. It add some methods to set color, background color and text effect on console easier using ANSI escape sequences.
leetcode-rating-predictor - Leetcode Rating Predictor built with Node. Browser extension and web interface.
Nightmare - A high-level browser automation library.
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
puppeteer - Node.js API for Chrome
page-ruler-redux - An awesome page ruler extension for google chrome
percollate - A command-line tool to turn web pages into readable PDF, EPUB, HTML, or Markdown docs.
monolith - ⬛️ CLI tool for saving complete web pages as a single HTML file
bootsnap - Boot large Ruby/Rails apps faster
sidebery - Firefox extension for managing tabs and bookmarks in sidebar.
Lol DBA - lol_dba is a small package of rake tasks that scan your application models and displays a list of columns that probably should be indexed. Also, it can generate .sql migration scripts.
headless-recorder - Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.