A small web crawler - WBot

Our great sponsors

WorkOS - The modern identity platform for B2B SaaS

InfluxDB - Power Real-Time Data Analytics at Scale

SaaSHub - Software Alternatives and Reviews

Our great sponsors

wbot

2 17 4.6 Go

A simple & efficient web crawler.

I've been working on a small web crawler. https://github.com/twiny/wbot

chromedp

27 10,367 4.9 Go

A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

to use headless chrome to fetch dynamically rendered sites.

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project