Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Web Extension and CLI tool for saving a faithful copy of an entire web page in a single HTML fileProject mention: Selfhosted service to screenshot websites - but I'm not finding the options I need | reddit.com/r/selfhosted | 2023-03-02
💯 Teach puppeteer new tricks through plugins.Project mention: how can i bypasd 403 forbidden? | reddit.com/r/webscraping | 2023-03-09
There is a good chance that the website is using Cloudflare to block web scrapers, which will require you to use a fortified headless browser to solve the JS challenges. Your options include the Puppeteer stealth plugin and Selenium undetected-chromedriver.
Appwrite - The Open Source Firebase alternative introduces iOS support . Appwrite is an open source backend server that helps you build native iOS applications much faster with realtime APIs for authentication, databases, files storage, cloud functions and much more!
A command-line tool to turn web pages into readable PDF, EPUB, HTML, or Markdown docs.Project mention: Selfhosted service to screenshot websites - but I'm not finding the options I need | reddit.com/r/selfhosted | 2023-03-02
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?Project mention: Hey! Another FREE guide for you! | reddit.com/r/proxies | 2022-04-18
So he here is a link to the original, true Github repo, so at least the author might get reimbursed via his affiliation links and get rightfully paid rather than just plagiarized by other proxy blogs - https://github.com/niespodd/browser-fingerprinting
Webpack plugin to generate the skeleton page automatically
📷 BrowserBox - Remote isolated browser API for security, automation visibility and interactivity. Run on our cloud, or bring your own. Full scope double reverse web proxy with multi-tab, mobile-ready browser UI frontend. Plus co-browsing, advanced adaptive streaming, secure document viewing and more! But only in the Pro version. Get BB today! Secure your document needs and internet, today!Project mention: Show HN: BrowserBox – embed remote browsers anywhere | news.ycombinator.com | 2023-03-24
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Automating Web Performance testing with Puppeteer 🎪
Make website screenshots and mobile emulations from the command line.
Capture screenshots of websites
Web Extension for Firefox/MS Edge and CLI tool to save a faithful copy of an entire web page in a self-extracting HTML/ZIP polyglot fileProject mention: Password protect a static HTML page | news.ycombinator.com | 2023-02-18
You can do the same thing with SingleFileZ  which can protect saved pages with a password. It relies on the zip specification to store encrypted resources.
I went down a crazy rabbit hole gathering all kinds of data and analyzing the open source projects that Codesmith has. I'm very fast and it took about 2 hours one Sunday afternoon. I logged alumni LinkedIns and GitHubs for ~200 people listed on these open source project individual websites. I found about 2/3 of people listed 6+ months of work experience on their LinkedIns as "Software Engineers" but when looking at their GitHub contributions to the projects, committed on average over 2-3 week long periods only. All of these projects had the exact same spiky patterns, it was crazy, over and over and over and over again, like this: https://github.com/open-source-labs/spearmint/graphs/contributors and over and over people listing months and sometimes years of experience on their LinkedIns.
Capture screenshots of websites from the command-lineProject mention: URL to PDF and Image | reddit.com/r/selfhosted | 2022-11-26
Perhaps this one?
🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.
All-in-one bot, with auto captcha-solving and proxy management, using Node.js and Puppeteer.Project mention: Reselling di Sneakers? | reddit.com/r/flippingitalia | 2023-03-03
Generate tiktok signature token using nodeProject mention: I created a signer to sign TikTok API endpoints | reddit.com/r/rust | 2023-02-26
The inspiration was taken from https://github.com/carcabot/tiktok-signature so usage is pretty similar.
Puppeteer as a service
Convert AsciiDoc documents to PDF using web technologiesProject mention: Why isn't there a free tier of MadCap Flare for sample projects or self learning? | reddit.com/r/technicalwriting | 2023-01-26
Asciidoctor-web-pdf https://github.com/Mogztter/asciidoctor-web-pdf for web-based PDF with Paged.JS and CSS.
☕️ TDD with Browserify, Mocha, Headless Chrome and WebDriver
:white_square_button: WhatsApp chat from commandline/console/cli using GoogleChrome puppeteer
Serverless Framework + AWS Lambda Layers + Puppeteer = ❤️
Plugin for website-scraper which returns html for dynamic websites using puppeteerProject mention: Scaricare una pagina web per studiarla | reddit.com/r/ItalyInformatica | 2022-04-02
New headless Chrome has been released and has a near-perfect browser fingerprint
4 projects | news.ycombinator.com | 19 Feb 2023
Proposed solution to twitter's ridiculous API pricing
1 project | reddit.com/r/ProgrammerHumor | 8 Feb 2023
Why isn't there a free tier of MadCap Flare for sample projects or self learning?
1 project | reddit.com/r/technicalwriting | 26 Jan 2023
Reverse Engineering or Recreating the Chrome Extension?
1 project | reddit.com/r/RemarkableTablet | 21 Jan 2023
Using selenium with proxy still hit bot detection
2 projects | reddit.com/r/webscraping | 16 Jan 2023
Getting detected by Cloudflare for no apparent reason.
1 project | reddit.com/r/webscraping | 12 Jan 2023
Will knowing AsciiDoc be a resume booster?
1 project | reddit.com/r/technicalwriting | 5 Jan 2023
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Mar 2023