Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.Project mention: Headless recorder is a Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script. | reddit.com/r/vuejs | 2021-07-20
Web Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML fileProject mention: How do I save a website that I have open, but has been deleted from the internet? | reddit.com/r/DataHoarder | 2022-01-16
You could try installing SingleFile and saving it with that. For video content you could try right-clicking and saving the video files manually if there aren't too many.
OPS - Build and Run Open Source Unikernels. Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.
A command-line tool to turn web pages into beautiful, readable PDF, EPUB, or HTML docs.Project mention: What Are The Best Linux Apps? | reddit.com/r/linuxquestions | 2022-01-05
VENOM love at first sight The documentation was straight forward and it got the right amount of stars and maintainers so I $~ npm install venom-bot and started coding.
💯 Teach puppeteer new tricks through plugins.Project mention: Is something similar possible? | reddit.com/r/webscraping | 2021-12-24
If you scrape multiple sites and don't want to analysis the backend API, simply use puppeteer and puppeteer-extra, or simillar plugins like this. (Note: Most of headless browser based SaaS, DaaS api services based on this)
Run your tests using Jest & Puppeteer 🎪✨Project mention: Evaluation of Microsoft Playwright | dev.to | 2021-03-04
jest-playwright is added to the jest configuration as a preset which makes all the features available to be used at your disposal. It was inspired by jest-puppeteer.
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?Project mention: what are the rules to identify web visits as bot/scraper | reddit.com/r/datascience | 2021-11-23
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
Webpack plugin to generate the skeleton page automaticallyProject mention: Killblanks use pre-render and skeleton screen to solve page blanks | dev.to | 2021-03-08
Yes, it is @Jocs, who shared A scheme for automatically generating skeleton screens, and the subsequent open source page-skeleton-webpack-plugin, providing a lower cost solution The plan of the skeleton screen provides a new idea for the realization of the skeleton screen. For the specific plan, please see his article
Make website screenshots and mobile emulations from the command line.Project mention: Screenshoteer - Makes web screenshots and mobile emulations from the command line. | dev.to | 2021-02-01
Automating Web Performance testing with Puppeteer 🎪Project mention: Timing with Curl | news.ycombinator.com | 2021-10-31
Had no idea curl could do this. If you need a deeper dive, you can do something similar with headless chrome and the chrome remote dev tools protocol.
There's a good example with puppeteer, here:
https://github.com/addyosmani/puppeteer-webperf#devtools-pro... (Ctrl-F, and search for "Get Navigation Timing API metrics").
There are other snippets there that you can turn into text command line tools too.
📷 ViewFinder - Remote isolated browser API for security, automation visibility and interactivity. Run on our cloud, or bring your own. Full scope double reverse web proxy with multi-tab, mobile-ready browser UI frontend. Plus co-browsing, advanced adaptive streaming, secure document viewing and more! But only in the Pro version. Get Viewfinder today! Secure your document needs and internet, today!Project mention: Show HN: Web proxy in iframe with Flash and incognito tabs | news.ycombinator.com | 2022-01-17
This work is based on this project on GitHub:
The version used in the above live demo has many advanced features (as you can see in the comparison), including, Flash now as well. Thanks to the wonderful Ruffle Flash emulator project, written in Rust
Capture screenshots of websitesProject mention: Sindresorhus/capture-website: Capture screenshots of websites | news.ycombinator.com | 2021-02-11
Web Extension for Firefox/MS Edge and CLI tool to save a faithful copy of an entire web page in a self-extracting HTML/ZIP polyglot fileProject mention: How do you save / archive web pages for references in notes? | reddit.com/r/orgmode | 2021-12-13
I'm using SingleFileZ which stores my whole web traffic into single-HTML files (one per page including images and such). They are stored in files like 2021-12-14T14.20.34 hostname - karl-voit.at - What App am I Using for What and How.html which I can link to my Org-mode via my-webarchive-tsfile () from my configuration.
☕️ TDD with Browserify, Mocha, Headless Chrome and WebDriver
:white_square_button: WhatsApp chat from commandline/console/cli using GoogleChrome puppeteerProject mention: Whatsapp in commandline | reddit.com/r/archlinux | 2021-03-26
Convert AsciiDoc documents to PDF using web technologiesProject mention: Beautiful PDFs from HTML | news.ycombinator.com | 2021-04-04
Asciidoctor has a web PDF tool that just went alpha a little bit ago, uses the same stack as the OP's thingie.
The content handoff goes like this: Asciidoc (using defined roles) generates HTML5 (Pagedjs polyfills page areas / pagination stuff), CSS styles stuff, and Puppeteer runs a headless Chromium for the pdf render. It's straight from CSS GCPM W3C spec, a flavor of CSS Paged Media, drafts that have been percolating since frickin' 2006 but have never seen browser implementation.
Serverless Framework + AWS Lambda Layers + Puppeteer = ❤️Project mention: how to ddeploy pupeteer lambda function on aws | reddit.com/r/awslambda | 2021-07-17
According to this you should skip downloading chrome in pupeteer: https://github.com/RafalWilinski/serverless-puppeteer-layers
Private API to enable API access for Roam Research. Now you can connect Roam to your other projects.Project mention: Using RoamPrivateApi, how to append blocks to existing pages? | reddit.com/r/RoamResearch | 2021-09-26
A screenshot API to convert web to image or PDF. Supports desktop and mobile views. (by staticallyio)Project mention: Generating PDF dynamically | reddit.com/r/nextjs | 2021-12-11
github repo: https://github.com/staticallyio/screenshot
Instagram automation driven by headless chrome.Project mention: How I grow my Instagram account with consistent Instagram posts | dev.to | 2021-03-20
The next step is to post the image to Instagram. If you own a non-business account, the only way now is to use Puppeteer to post the image https://github.com/transitive-bullshit/puppeteer-instagram. You might encounter various issues with using Puppeteer.
An automation process to convert YouTube video into audio file and uploading it to Anchor.fm podcastProject mention: How to transform your blog into a podcast for free | dev.to | 2021-04-20
I found a github repository, made by an Italian organization named Schrodinger-Hat 🐱💻, for converting a youtube video into an audio file and uploading it to anchor.fm. The upload task used puppeteer for that and I thought it was quite cool and simple, so I just forked it 😏. They are great, check them out!
Fingerprint Changing Chrome Extension
3 projects | reddit.com/r/PrivacyGuides | 2 Jan 2022
Is something similar possible?
1 project | reddit.com/r/webscraping | 24 Dec 2021
what are the rules to identify web visits as bot/scraper
1 project | reddit.com/r/datascience | 23 Nov 2021
Possible to outsource solving the press and hold captcha page?
1 project | reddit.com/r/webscraping | 11 Nov 2021
Alternatives to ArchiveBox?
7 projects | reddit.com/r/selfhosted | 30 Oct 2021
Avoiding bot detection: How to scrape the web without getting blocked?
1 project | reddit.com/r/patient_hackernews | 31 Oct 2021
Avoiding bot detection: How to scrape the web without getting blocked?
1 project | reddit.com/r/CKsTechNews | 31 Oct 2021
Are you hiring? Post a new remote job listing for free.