How to build your own LinkedIn Profile Scraper in 2022

This page summarizes the projects mentioned and recommended in the original post on dev.to

Civic Auth - Simple auth for Python backends
Drop Civic Auth into your Python backend with just a few lines of code. Email login, SSO, and route protection built-in. Minimal config. Works with FastAPI, Flask, or Django.
www.civic.com
featured
Sevalla - Deploy and host your apps and databases, now with $50 credit!
Sevalla is the PaaS you have been looking for! Advanced deployment pipelines, usage-based pricing, preview apps, templates, human support by developers, and much more!
sevalla.com
featured
  1. linkedin_scraper

    This is the 2022 version of the linkedin scraper (by yokwejuste)

    The full source code available on GitHub, feel free to give me a star, create issues, make pull requests and lets promote the opensource communnity.

  2. Civic Auth

    Simple auth for Python backends. Drop Civic Auth into your Python backend with just a few lines of code. Email login, SSO, and route protection built-in. Minimal config. Works with FastAPI, Flask, or Django.

    Civic Auth logo
  3. CPython

    The Python programming language

    Python

  4. virtualenv

    Virtual Python Environment builder

    Python is the chosen language for this tutorial and as you can guess some precautions should be done to make sure that the environment is setup correctly and the main OS I'll use is Ubuntu(a Linux distro) virtual environment is a tool that helps you to isolate your code from the rest of the system. It is a good idea to create a virtual environment for your project.

  5. murder

    Large scale server deploys using BitTorrent and the BitTornado library (by ervinb)

    Web scraping is mostly used on sites with big data like Google, Amazon or Twitter. As a whole web scraping is refers to the extraction of data from a website. This information is collected and then exported into a format that is more useful for the user mostly csv file though some other formats are also possible like json.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Software Rot

    3 projects | news.ycombinator.com | 6 Aug 2025
  • Setup and use Virtualenv in Python Applications

    1 project | dev.to | 11 Apr 2024
  • What is the official "preferred" way to install pip and virtualenv systemwide?

    1 project | /r/codehunter | 12 Apr 2022
  • My Journey Through Python Virtual Environments

    2 projects | dev.to | 16 May 2025
  • How Python virtual environments work

    6 projects | news.ycombinator.com | 13 Mar 2023

Did you know that Python is
the 2nd most popular programming language
based on number of references?