Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
og-image.
-
Imagegen as a Service (Free), All Bloggers Should Have One
Special thanks to Vercel's og-image, this project is heavily inspired by og-image.
puppeteer
-
How to Scrape Dynamic Content with Selenium and Beautiful Soup
Use Selenium or Third-Party APIs: Utilize tools like Selenium / Puppeteer or third-party APIs such as the Crawlbase Crawling API to load the webpage. These tools can handle JavaScript rendering, ensuring all dynamic content is displayed.
-
The Puppeteer Language Experiment
This project tests how the browser language can be changed with Puppeteer. It implements multiple options to set the language of Chrome and checks each option against BrowserLeaks to see how it affected the JavaScript proeprties and HTTP headers available by the browser. For more information, see my article The Puppeteer Language Experiment on DEV.to.
-
Scrapy Vs. Crawlee
In Crawlee, you can scrape JavaScript rendered websites using the built-in headless Puppeteer and Playwright browsers. It is important to note that, by default, Crawlee scrapes in headless mode. If you don't want headless, then just set headless: false.
-
Hacking out an AI spider with Node
Some quick docs fumbling and you get a working script for loading the page and grabbing the innerHTML of the listing element like so:
-
Sometimes things simply don't work
I am not in any way associated with the developers at puppeteer, but if you are looking for a way to contribute, they are open source
-
The best testing strategies for frontends
With the advent of tools like Puppeteer and now Playwright, end-to-end testing has become much easier and more reliable. For anyone who's used Selenium in the past, you know what I'm talking about. Puppeteer has opened the way in terms of E2E tooling, but Playwright has taken it to the next level and made it easier to await for certain selectors or conditions to be fulfilled (via locators), thus making tests more reliable and less flaky. Also, it's a game changer that it introduced a test-runner - this made the integration between the headless browser and the actual test code much smoother.
-
Learn Automated Testing At Home: A Beginner's Guide
1.Puppeteer: Puppeteer is a Node library that provides a high-level API to control headless Chrome or Chromium using the DevTools Protocol. Key Features: More control over Chrome. Enables web scraping. Allows taking screenshots and generating PDFs for UI testing. Measures load times through the Chrome Performance Analysis tool
-
HTML to PDF renderers: A simple comparison
HTML to PDF conversion is a common requirement in modern web applications. It allows users to save web pages, reports, and other content in a format that is easy to share and print. There are many libraries and services available for converting HTML to PDF, each with its own strengths and weaknesses. In this article, we will compare some of the most popular HTML to PDF renderers in Node.js, including Puppeteer, Playwright, node-html-pdf, and Onedoc.
-
Let's build a screenshot API
Playwright seems to be a superior library for working with headless browsers than Puppeteer, but I will go with Puppeteer.
-
JS Toolbox 2024: Bundlers and Test Frameworks
Puppeteer is a Node library that provides a high-level API to control headless Chrome or Chromium. It's primarily used for browser automation, making it a powerful tool for end-to-end testing of web applications, taking screenshots, and generating pre-rendered content from web pages.
What are some alternatives?
img - 🌠Imagegen (image generator) as a Service, built with Next.js and Vercel
axios - Promise based HTTP client for the browser and node.js
Nightmare - A high-level browser automation library.
Playwright - Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
WKHTMLToPDF - Convert HTML to PDF using Webkit (QtWebKit)
puppeteer-extra - 💯 Teach puppeteer new tricks through plugins.
karma - Spectacular Test Runner for JavaScript
pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)
cheerio - The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
Pdfkit - A Ruby gem to transform HTML + CSS into PDFs using the command-line utility wkhtmltopdf
phantomjs - Scriptable Headless Browser
Electron - :electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS