Top 23 Puppeteer Open-Source Projects
Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.Project mention: Headless recorder is a Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script. | reddit.com/r/vuejs | 2021-07-20
Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content.Project mention: Is it safe to put a potentially unsafe application in a docker container in a server? | reddit.com/r/docker | 2021-07-27
I've been developing an application that uses url-to-pdf-api, which is basically an api for puppetteer js.
A Headless Chrome rendering solutionProject mention: Rendertron – A Headless Chrome Rendering Solution | news.ycombinator.com | 2021-10-06
Web Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML fileProject mention: Should locally stored webpages adjust for the display size like they do on the "live web"? | reddit.com/r/firefox | 2021-10-17
I've saved some webpages with Singlefile -- a recommended addon, can be automated, in active development... supposedly high compatibility with websites. The pages I've saved in the past (such as a Wordpress blog recently) have displayed the (mobile and desktop) layouts accordingly, but eurogamer.net shows the full-blown desktop site on Android, and vice versa (the mobile site on desktop).
A command-line tool to turn web pages into beautiful, readable PDF, EPUB, or HTML docs.Project mention: Reading from the web offline and distraction-free | news.ycombinator.com | 2021-10-10
I do a lot of this work (web to documents) and it's interesting to see other approaches. The medium image problem is something I've faced as well, but never got around to fixing. I'm planning to get a Remarkable soon, so will definitely be trying this out.
My personal solution has been https://github.com/captn3m0/url-to-epub/ (Node/readability), which I've tested against the entirety of Tor's original fiction collection where it performs well enough (I'm biased). Another tool that does this beautifully well is percollate, but it doesn't give enough control of the metadata to the user - something I really care about.
I've also started to use rdrview, which is a C-port of the current Firefox implementation of "reader view". It is very unix-y, so it is easy to pipe content to it (I usually run it through tidy first). Quite helpful in building web-archiving or web-to-pdf or web-to-kindle pipelines easily.
VENOM love at first sight The documentation was straight forward and it got the right amount of stars and maintainers so I $~ npm install venom-bot and started coding.
Run your tests using Jest & Puppeteer 🎪✨Project mention: Evaluation of Microsoft Playwright | dev.to | 2021-03-04
jest-playwright is added to the jest configuration as a preset which makes all the features available to be used at your disposal. It was inspired by jest-puppeteer.
Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
💯 Teach puppeteer new tricks through plugins.Project mention: Best approach for 14K links | reddit.com/r/webscraping | 2021-07-21
At time one of the best "ready to go" product to unblock you is scrapfly, the ASP feature works pretty well https://scrapfly.io/docs/scrape-api/anti-scraping-protection. They seem to manage fingerprint, spoofing very well. It's from one of the guy of https://github.com/berstend/puppeteer-extra/wiki/Scraping-Chat
A Docker-powered stateless API for PDF files.Project mention: PDF Invoice generator best deployment platform | reddit.com/r/node | 2021-08-12
you can use this service with docker https://gotenberg.dev/
🐺 Create browser tests 10x fasterProject mention: Test receiving an email in 2 minutes | dev.to | 2021-02-25
View on GitHub
Webpack plugin to generate the skeleton page automaticallyProject mention: Killblanks use pre-render and skeleton screen to solve page blanks | dev.to | 2021-03-08
Yes, it is @Jocs, who shared A scheme for automatically generating skeleton screens, and the subsequent open source page-skeleton-webpack-plugin, providing a lower cost solution The plan of the skeleton screen provides a new idea for the realization of the skeleton screen. For the specific plan, please see his article
Generate critical css for your web pagesProject mention: What to do for website speed optimization? | reddit.com/r/FreeCodeCamp | 2021-03-30
inline critical css (here is a useful tool https://jonassebastianohlsson.com/criticalpathcssgenerator/) , and here an explanation (https://web.dev/extract-critical-css/).
Chromium Binary for AWS Lambda and Google Cloud FunctionsProject mention: Create PDF documents with AWS Lambda + S3 with NodeJS and Puppeteer | dev.to | 2021-08-14
git clone --depth=1 https://github.com/alixaxel/chrome-aws-lambda.git && \ cd chrome-aws-lambda && \ make chrome_aws_lambda.zip
Puppeteer Pool, run a cluster of instances in parallelProject mention: Redis with puppeteer for web scraping | reddit.com/r/puppeteer | 2021-01-11
https://github.com/thomasdondorf/puppeteer-cluster is doing queue-like mechanism but it is not using redis.
Headless Chrome .NET APIProject mention: Best PDF generation library to create nested tables | reddit.com/r/csharp | 2021-08-31
Another idea is to maybe generate the document as HTML first and then convert the HTML to a PDF (with somehting like PuppeteerSharp. I have found this more flexible in the past, but I have not personally done with with nested tables.
Headless chrome/chromium automation library (unofficial port of puppeteer)
Automates PWA asset generation and image declaration. Automatically generates icon and splash screen images, favicons and mstile images. Updates manifest.json and index.html files with the generated images according to Web App Manifest specs and Apple Human Interface guidelines.Project mention: Kickin - bootstrap your Eleventy project | dev.to | 2021-10-18
If you want to create PWA, you will need icons for your application for different platforms. This package uses pwa-assets-generator to create icons from an image. It will automatically insert links to icons into the HTML of every page and in the manifest.json file along with generated icons. All you need is an image as a template for future icons. By default, it is a favicon.png under the src directory.
A curated list of awesome puppeteer resources.Project mention: Scraping with selenium + docker | reddit.com/r/dataengineering | 2021-02-20
Curated list for Puppeteer: https://github.com/transitive-bullshit/awesome-puppeteer
Make website screenshots and mobile emulations from the command line.Project mention: Screenshoteer - Makes web screenshots and mobile emulations from the command line. | dev.to | 2021-02-01
Capture screenshots of websitesProject mention: Sindresorhus/capture-website: Capture screenshots of websites | news.ycombinator.com | 2021-02-11
The largest UI testing best practices list (last update: May 2021)Project mention: API testing event driven systems | dev.to | 2021-09-18
This is an anti-pattern in testing. We should Await, not Sleep, but this is not possible with the majority of the API testing tools.
A Puppeteer bridge for PHP, supporting the entire API.Project mention: PHP Interact with remote website | reddit.com/r/PHPhelp | 2021-04-12
What are some of the best open-source Puppeteer projects? This list will help you:
Are you hiring? Post a new remote job listing for free.