Top 3 C# web-crawler Projects

abot

1 2,072 0.0 C#

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Project mention: Can you build a web crawler in c#? | reddit.com/r/learnprogramming | 2022-04-11

This can be done perfectly well in c#, https://github.com/sjdirect/abot for example.
Infinity Crawler

0 203 3.3 C#

A simple but powerful web crawler library for .NET
InfluxDB

www.influxdata.com
sponsored

Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
search-engine-microservices-with-redis-stack

1 1 4.5 C#

Search engine system for articles using redis technology stack. This project was produced for the participation of the Redis hackathon promoted by the Dev Community. https://dev.to/devteam/announcing-the-redis-hackathon-on-dev-3248

Project mention: Articles Discovery Engine | dev.to | 2022-08-29

RediSearch search indexed documents:

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-08-29.