Top 15 TypeScript Puppeteer Projects
A Headless Chrome rendering solutionProject mention: How to combine React Native Web + responsivity + NextJS SSR, to get SEO | dev.to | 2021-09-08
Googlebot: SSR a non-responsive mobile version only for the Googlebot User Agent, to get SEO. But do Client-Side Rendering (CSR) for users, to get full responsivity. Could be done with manual user-agent sniffing, or with a GoogleChrome/Rendertron proxy. Though Google may not like being fed something different than users (different initial markup, even though resulting markup after React’s first CSR should be the same). But it might be problematic long-term to SSR only for the Googlebot, since it’s effectively serving the Googlebot something else than what the users get.. Google might crack down on it, since it could be abused.
🐺 Create browser tests 10x fasterProject mention: Test receiving an email in 2 minutes | dev.to | 2021-02-25
View on GitHub
Chromium Binary for AWS Lambda and Google Cloud FunctionsProject mention: Create PDF documents with AWS Lambda + S3 with NodeJS and Puppeteer | dev.to | 2021-08-14
git clone --depth=1 https://github.com/alixaxel/chrome-aws-lambda.git && \ cd chrome-aws-lambda && \ make chrome_aws_lambda.zip
Puppeteer Pool, run a cluster of instances in parallelProject mention: Redis with puppeteer for web scraping | reddit.com/r/puppeteer | 2021-01-11
https://github.com/thomasdondorf/puppeteer-cluster is doing queue-like mechanism but it is not using redis.
Automates PWA asset generation and image declaration. Automatically generates icon and splash screen images, favicons and mstile images. Updates manifest.json and index.html files with the generated images according to Web App Manifest specs and Apple Human Interface guidelines.Project mention: Simple Progressive Web Apps - Allow Users to Install Your WebSite or WebApp | dev.to | 2021-08-15
Proxy server to bypass Cloudflare protectionProject mention: Cloudproxy – hide your scrapers IP behind the cloud | news.ycombinator.com | 2021-06-26
Even though I only do it for hobby projects, crawling pages is becoming increasingly difficult unless you are a big player like Google or Microsoft with a whitelisted IP range.
I've had some success in scraping lately with a similar project called FlareSolverr(1).
It's purpose it to get you access to sites which won't let you crawl unless you are using a real browser (e.g amazon, instagram). It doesn't hide your IP but uses puppeteer with stealth mode to get you access to otherwise restricted urls.
Efficient embeddable adblocker libraryProject mention: Can uBO be used in programs outside of browsers? | reddit.com/r/uBlockOrigin | 2021-05-02
Author of RSS Guard here. After considering many approaches, I managed to dump old C++-based slow adblocking mechanism from RSS Guard and replaced it with this.
Run Linux Software Faster and Safer than Linux with Unikernels.
🧶 Extract data from any website without code, just clicks.Project mention: I made a chrome extension that sits on top of a page and allows you to generate a puppeteer script by directly selecting HTML elements. Feel free to join the development team 🧶 | reddit.com/r/webdev | 2021-02-06
🔍 Root Cause is a tool for troubleshooting Puppeteer and Playwright tests. 🔎
Framework independent visual testing libraryProject mention: Looking for an example of a well documented React TypeScript project | reddit.com/r/typescript | 2021-01-30
I use tsdoc + typedoc to generate the documentation for Mugshot, a visual regression testing library. You can see the docs at http://nighttrax.github.io/mugshot/ and the code at https://github.com/NiGhTTraX/mugshot. I found it pretty useful to write the documentation close to the code so that users of the library will get a nice experience in their IDE when they hover over methods and on top of that also generate some pretty online docs.
I'm currently implementing concurrency conditions at project/proxy/domain/session level in https://github.com/get-set-fetch/scraper . On each level you can define the maximum number of requests and the delay between two consecutive requests.
Login to your ING Australia bank account using puppeteerProject mention: Automatic Bank Import with YNAB 4 | reddit.com/r/ynab | 2021-06-27
Fortunately Adam Royle did the hard work for me https://github.com/adamroyle/ing-au-login creating a script which can log into my bank (it uses a tricky numpad where the numbers change around).
Makes visual reviews of web app releases easy.Project mention: CLI tool to ease visual review of a web site or app, powered by Puppeteer | reddit.com/r/webdev | 2021-08-15
simple async run-anywhere js testing frameworkProject mention: What Are Some Best Practices For Learning Code | reddit.com/r/learnprogramming | 2021-02-17
i'm looking forward to finalizing my libraries for testing cynic, building api's renraku, generating import maps importly, and embedding shopify stores shopper
Project mention: I used Puppeteer to submit a bunch of fake data to a scammer's website | reddit.com/r/webdev | 2021-05-26
What are some of the best open-source Puppeteer projects in TypeScript? This list will help you:
Are you hiring? Post a new remote job listing for free.