weibo-crawler vs Photon

weibo-crawler

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频 (by dataabc)

Source Code

Suggest alternative

Edit details

Photon

Incredibly fast crawler designed for OSINT. (by s0md3v)

Crawler Spider Python Osint information-gathering

Source Code

Suggest alternative

Edit details

InfluxDB - Power Real-Time Data Analytics at Scale

Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

www.influxdata.com

featured

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

featured

weibo-crawler		Photon
	Project
1	Mentions	3
3,073	Stars	10,513
-	Growth	-
5.4	Activity	0.0
24 days ago	Latest Commit	4 months ago
Python	Language	Python
-	License	GNU General Public License v3.0 only

The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

weibo-crawler

Posts with mentions or reviews of weibo-crawler. We have used some of these posts to build our list of alternatives and similar projects.

紧急求助🆘备份@我能抱起120斤
1 project | /r/DoubanGoosegroup | 15 Jul 2022

Photon

Posts with mentions or reviews of Photon. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-12-27.

How is ArchiveBox?
4 projects | /r/selfhosted | 27 Dec 2021

If you need more advanced recursive spider/crawling ability beyond --depth=1, check out Browsertrix, Photon, or Scrapy and pipe the outputted URLs into ArchiveBox.
Getting started in OSINT
1 project | /r/OSINT | 18 Oct 2021

Good place to start: https://github.com/s0md3v/Photon
How do I fix 'module not found: tld' even though it's already installed
1 project | /r/learnpython | 2 Aug 2021

Whenever I try to run Photon from my python script it gives me the error 'module not found: tld' even though the module is already installed and Photon works just fine if I run it normally from my terminal

What are some alternatives?

When comparing weibo-crawler and Photon you can also consider the following projects:

toapi - Every web site provides APIs.

Profil3r - OSINT tool that allows you to find a person's accounts and emails + breached emails 🕵️

weibo-scraper - Simple Weibo Scraper

browsertrix-crawler - Run a high-fidelity browser-based crawler in a single Docker container

scrapy-iltasanomat-kuntavaalit2021 - Fetch Sanoma kuntavaalit 2021 data

podcatcher - Audio media crawler for lbry.

scrapy-sanoma-kuntavaalit2021 - Fetch Sanoma kuntavaalit 2021 data [Moved to: https://github.com/raspi/scrapy-kuntavaalit2021-sanoma]

google-play-scraper - Google play scraper for Python inspired by <facundoolano/google-play-scraper>

rewe-discounts - Grabs current REWE discounts and saves them in a markdown file || Holt sich aktuelle REWE-Angebote und exportiert sie in eine Markdown-Liste

PSpider - 简单易用的Python爬虫框架，QQ交流群：597510560

telegramscraper - Scraper and adder for Telegram supporting multiple accounts at the same time. Adds via Telegram API and only by username. For adding via ID and not needing Telgram API contact me.

webspot - An intelligent web service to automatically detect web content and extract information from it.