PathDict
URS
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PathDict
-
I've built a PathDict, a library that makes it easy to work with dicts!
Here is the Github Link and the PyPi Page if you wanna take a look!
URS
-
Nitter Shutting Down
If they don't want you to use their API just respect their wishes and scrape Reddit. https://github.com/JosephLai241/URS it's the only moral thing we can do.
- GitHub - JosephLai241/URS: Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
-
I'm a complete beginner and would like to use a scraper on r/conspiracys for a school project
For future visitors the steps that this user needed were: (Install python 3.7) git clone --depth=1 https://github.com/JosephLai241/URS.git cd URS pip3 install . -r requirements.txt Then edit the .env contained in the directory with the reddit api credentials
-
Pulling comments from threads with "keyword" in their title?
Just used this repo to do exactly this for a PhD program project. https://github.com/JosephLai241/URS
- 技术老嗨给个支援，有没有好的词频统计方法。试了结巴包感觉词典漏掉了很多，爬了一堆txt留言连紫蜡烛和西朝鲜的的词频都没识别出来
-
Visualizing Data from Pushshift
Shameless plug - I wrote URS which allows you to export comments to JSON in a thread structure. Take a look at the samples branch for examples.
-
Question for using the Universal Reddit Scraper (URS)
I'm new to python, and coding generally. I'm using a great tool called the Universal Reddit Scraper (https://github.com/JosephLai241/URS) to pull some reddit data. It allows you to scrape subreddits, among other things. It creates a CSV file with list of submissions in a given subreddit with each one's ID as a column.
-
Tools for downloading Reddit user profiles and subreddits?
Because I'm not sure this guy does everything you want https://github.com/JosephLai241/URS
-
Wordcloud /r/suomi all-time Top100 postauksista
Toteutettu Universal Reddit Scraperillä.
- My issue with the Transgender_Surgeries Wiki - and how I propose to solve this issue
What are some alternatives?
CleverCSV - CleverCSV is a Python package for handling messy CSV files. It provides a drop-in replacement for the builtin CSV module with improved dialect detection, and comes with a handy command line application for working with CSV files.
asyncpraw - Async PRAW, an abbreviation for "Asynchronous Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
Box - Python dictionaries with advanced dot notation access
reddit-analyzer - Simple python script to analyze reddit accounts
python-benedict - :blue_book: dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, html, ini, json, pickle, plist, query-string, toml, xls, xml, yaml), s3 support and many utilities.
RedditDownloader - Scrapes Reddit to download media of your choice.
jmespath.py - JMESPath is a query language for JSON.
Reddit-Crawler - Crawls for all posts and link comments from a specfic user and posts them to a specific subreddit. Utilizes PRAW and attempts to prevent reposts
canmatrix - Converting Can (Controller Area Network) Database Formats .arxml .dbc .dbf .kcd ...
redditcoins-backend - Pull reddit data from APIs and store it in local db
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
whatsapp-osint - WhatsApp spy - logs online/offline events from ANYONE in the world