Top 7 C# Crawler Projects

PuppeteerSharp

16 3,162 9.3 C#

Headless Chrome .NET API

Project mention: What do .NET devs use for web scraping these days? | /r/dotnet | 2023-06-13

PuppeteerSharp

abot

1 2,204 0.0 C#

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
TumblThree

4 565 8.0 C#

A Tumblr and Twitter Blog Backup Application
Infinity Crawler

0 238 5.0 C#

A simple but powerful web crawler library for .NET
custom-crawler

1 57 2.8 C#

🌌 High productivity semi-automatic crawler generator 🛠️🧰
Spidey

2 11 9.5 C#

A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.
Scraper

1 2 10.0 C#

A simplistic web scraper which aims to make scrapping webpages and crawling links faster by utilizing parallel threading. (by 0x78f1935)
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).