Top 23 JavaScript Puppeteer Projects
-
headless-recorder
Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.
Project mention: Headless recorder is a Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script. | reddit.com/r/vuejs | 2021-07-20 -
SingleFile
Web Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file
Project mention: Ask HN: What browser extensions are a must-have for HNers in 2021? | news.ycombinator.com | 2021-11-22 -
-
Maybe https://github.com/danburzo/percollate, I didnt try it and I am not sure if the html output looks like u want it.
-
Project mention: I Built A Whatsapp Bot And Linked It To My Site Free (No third-party service) | dev.to | 2021-06-12
VENOM love at first sight The documentation was straight forward and it got the right amount of stars and maintainers so I $~ npm install venom-bot and started coding.
-
Project mention: Possible to outsource solving the press and hold captcha page? | reddit.com/r/webscraping | 2021-11-11
You can apply some of the evasions from https://github.com/berstend/puppeteer-extra/tree/master/packages/puppeteer-extra-plugin-stealth
-
jest-playwright is added to the jest configuration as a preset which makes all the features available to be used at your disposal. It was inspired by jest-puppeteer.
-
Project mention: Killblanks use pre-render and skeleton screen to solve page blanks | dev.to | 2021-03-08
Yes, it is @Jocs, who shared A scheme for automatically generating skeleton screens, and the subsequent open source page-skeleton-webpack-plugin, providing a lower cost solution The plan of the skeleton screen provides a new idea for the realization of the skeleton screen. For the specific plan, please see his article
-
Scout APM
Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
-
browser-fingerprinting
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
Project mention: what are the rules to identify web visits as bot/scraper | reddit.com/r/datascience | 2021-11-23 -
Project mention: Screenshoteer - Makes web screenshots and mobile emulations from the command line. | dev.to | 2021-02-01
Github: https://github.com/vladocar/screenshoteer
-
Had no idea curl could do this. If you need a deeper dive, you can do something similar with headless chrome and the chrome remote dev tools protocol.
There's a good example with puppeteer, here:
https://github.com/addyosmani/puppeteer-webperf#devtools-pro... (Ctrl-F, and search for "Get Navigation Timing API metrics").
There are other snippets there that you can turn into text command line tools too.
-
ViewFinder
:camera: ViewFinder - Remote isolated browser API for security, automation visibility and interactivity. Free web UI for headless Chrome browser. RBI. CBII. Remote browser isolation, embeddable BrowserView, secure chrome-as-a-service. Managed, variable bandwidth and co-browsing options available in Pro versions. Like S2, WebGap, Bromium, Authentic8, Menlo Security and Broadcom, but free and source-available. Integrated secure document viewing with CDR from https://github.com/dosyago/p2%2e
Project mention: ViewFinder - a virtualized browser running in your web browser (a.k.a. remote browser isolation) | reddit.com/r/browsers | 2021-11-19 -
Project mention: Sindresorhus/capture-website: Capture screenshots of websites | news.ycombinator.com | 2021-02-11
-
SingleFileZ
Web Extension for Firefox/MS Edge and CLI tool to save a faithful copy of an entire web page in a self-extracting HTML/ZIP polyglot file
Project mention: Save complete webpage and compact to a zip that I can opein in firefox? | reddit.com/r/firefox | 2021-10-25Author of SingleFile, you might prefer SingleFileZ, see https://github.com/gildas-lormeau/SingleFileZ, which produces exactly what you described: a zip file that you can read in Firefox (without needing to install the extension).
-
spearmint
Testing, simplified. || An inclusive, accessibility-first GUI for generating clean, semantic Javascript tests in only a few clicks of (or keystrokes) of a button.
Project mention: Spearmint – JavaScript Test-Code Generator – New In-App Testing | news.ycombinator.com | 2021-05-13 -
-
Whatspup
:white_square_button: WhatsApp chat from commandline/console/cli using GoogleChrome puppeteer
-
Asciidoctor has a web PDF tool that just went alpha a little bit ago, uses the same stack as the OP's thingie.
https://github.com/Mogztter/asciidoctor-web-pdf
The content handoff goes like this: Asciidoc (using defined roles) generates HTML5 (Pagedjs polyfills page areas / pagination stuff), CSS styles stuff, and Puppeteer runs a headless Chromium for the pdf render. It's straight from CSS GCPM W3C spec, a flavor of CSS Paged Media, drafts that have been percolating since frickin' 2006 but have never seen browser implementation.
-
Project mention: how to ddeploy pupeteer lambda function on aws | reddit.com/r/awslambda | 2021-07-17
According to this you should skip downloading chrome in pupeteer: https://github.com/RafalWilinski/serverless-puppeteer-layers
-
roam-research-private-api
Private API to enable API access for Roam Research. Now you can connect Roam to your other projects.
Project mention: Using RoamPrivateApi, how to append blocks to existing pages? | reddit.com/r/RoamResearch | 2021-09-26 -
Project mention: How I grow my Instagram account with consistent Instagram posts | dev.to | 2021-03-20
The next step is to post the image to Instagram. If you own a non-business account, the only way now is to use Puppeteer to post the image https://github.com/transitive-bullshit/puppeteer-instagram. You might encounter various issues with using Puppeteer.
-
youtube-to-anchorfm
An automation process to convert YouTube video into audio file and uploading it to Anchor.fm podcast
I found a github repository, made by an Italian organization named Schrodinger-Hat 🐱💻, for converting a youtube video into an audio file and uploading it to anchor.fm. The upload task used puppeteer for that and I thought it was quite cool and simple, so I just forked it 😏. They are great, check them out!
-
I personally use the Strava Heatmap via the layers provided by Anygis, which somehow seem to automatically fetch my cookie details. The links shown here work for me in JOSM: https://github.com/nnngrach/strava_auto_auth
-
puppeteer-demo
How to use Puppeteer to take webpage screenshots and generate dynamic Open Graph images for social sharing
Project mention: Three ways to use Puppeteer and Node.js to screenshot web pages and generate dynamic Open Graph images for social sharing | dev.to | 2021-03-17Harness the magic of Puppeteer in three ways: on the command line, as a serverless function in the background, or in a front-end application. Explore and fork this puppeteer-demo repository to see Puppeteer in action — and have fun creating dynamic Open Graph images for your websites or finding new ways to use Puppeteer!
JavaScript Puppeteer related posts
- what are the rules to identify web visits as bot/scraper
- Possible to outsource solving the press and hold captcha page?
- Alternatives to ArchiveBox?
- Avoiding bot detection: How to scrape the web without getting blocked?
- Avoiding bot detection: How to scrape the web without getting blocked?
- NoScript or uMatrix?
- develop & implement some of the most common uses of puppeteer via pptr.io
Index
What are some of the best open-source Puppeteer projects in JavaScript? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | headless-recorder | 13,721 |
| 2 | SingleFile | 4,299 |
| 3 | percollate | 3,529 |
| 4 | venom | 3,362 |
| 5 | puppeteer-extra | 3,298 |
| 6 | jest-puppeteer | 3,257 |
| 7 | page-skeleton-webpack-plugin | 2,604 |
| 8 | browser-fingerprinting | 2,569 |
| 9 | screenshoteer | 1,653 |
| 10 | puppeteer-webperf | 1,542 |
| 11 | ViewFinder | 1,438 |
| 12 | capture-website | 1,358 |
| 13 | SingleFileZ | 1,044 |
| 14 | spearmint | 952 |
| 15 | Mochify | 344 |
| 16 | Whatspup | 329 |
| 17 | asciidoctor-web-pdf | 290 |
| 18 | serverless-puppeteer-layers | 258 |
| 19 | roam-research-private-api | 142 |
| 20 | puppeteer-instagram | 79 |
| 21 | youtube-to-anchorfm | 50 |
| 22 | strava_auto_auth | 27 |
| 23 | puppeteer-demo | 24 |
Are you hiring? Post a new remote job listing for free.
