detectorist-scraper
A scrapy spider to extract post, thread, and user information from a vBulletin forum to a MongoDB database. (by IanLondon)
| warc-server | detectorist-scraper | |
|---|---|---|
| 1 | 1 | |
| - | 30 | |
| - | - | |
| - | 10.0 | |
| - | over 8 years ago | |
| Python | ||
| - | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
warc-server
Posts with mentions or reviews of warc-server.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-01-29.
detectorist-scraper
Posts with mentions or reviews of detectorist-scraper.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-01-29.
-
Ask HN: How can I back up an old vBulletin forum without admin access?
> I'm just not sure what the intermediate steps would be to get something usable like a vBulletin…
Once you have a crawl, you'll likely want to convert that unstructured data to structured data. For example, if I look at https://www.vbulletin.org/forum/portal.php, the thread title and hierarchy is in
, posts are in, etc. I see an old project (https://github.com/IanLondon/detectorist-scraper) that did this and may be a useful place to start, and I imagine there are others.Once you have the structured data, You can decide whether to use it to build a static site, to import it into another forum, etc.