Our great sponsors
-
linkedin-jobs-scraper
LinkedIn Jobs Scraper running in Node.js that uses Puppeteer and RxJS to scrape job offers from LinkedIn.
-
-
SurveyJS
Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
-
Some of the snippets in this blog may omit parts for clarity. You can find the complete code in this repository.
Web scraping may seem like a simple task, but there are many challenges to overcome. In this blog, we will dive into how to scrape LinkedIn to extract job listings. To do this, we will use Puppeteer and RxJS. The goal is to achieve web scraping in a declarative, modular, and scalable manner.
Puppeteer is a JavaScript library that allows you to control web browsers like Chrome for web scraping. Puppeteer enables us to script and monitor tasks such as navigating to a specific webpage and extracting the data we need. It's the ideal tool for web scraping because, being a web browser, it can overcome any potential obstacles, such as in the case of websites that require the execution of JavaScript to function or display data.
Related posts
- How to manipulate rendered HTML on the backend
- Generate invoice PDF file using HTML template
- Dynamic OG image with SvelteKit and Satori
- Hello, I would like to get feedback from developers about my nodejs micro framework for creating WhatsApp chatbots. They can open issues or send PR. For those who are interested, here is the repository. I await your reactions!
- CSS Selectors And XPath Locators In Selenium Test Automation Scripts