jsonjsc
URS
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jsonjsc
-
The YAML file of Prometheus Operator has over 13k lines, one of the longest YAML files on GitHub ever
And, if I can take a second to hock something I wrote, there are libraries to parse comments in most languages (though the one I wrote I feel does the best C style commenting).
URS
-
Nitter Shutting Down
If they don't want you to use their API just respect their wishes and scrape Reddit. https://github.com/JosephLai241/URS it's the only moral thing we can do.
- GitHub - JosephLai241/URS: Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
-
I'm a complete beginner and would like to use a scraper on r/conspiracys for a school project
For future visitors the steps that this user needed were: (Install python 3.7) git clone --depth=1 https://github.com/JosephLai241/URS.git cd URS pip3 install . -r requirements.txt Then edit the .env contained in the directory with the reddit api credentials
-
Pulling comments from threads with "keyword" in their title?
Just used this repo to do exactly this for a PhD program project. https://github.com/JosephLai241/URS
- 技术老嗨给个支援，有没有好的词频统计方法。试了结巴包感觉词典漏掉了很多，爬了一堆txt留言连紫蜡烛和西朝鲜的的词频都没识别出来
-
Visualizing Data from Pushshift
Shameless plug - I wrote URS which allows you to export comments to JSON in a thread structure. Take a look at the samples branch for examples.
-
Question for using the Universal Reddit Scraper (URS)
I'm new to python, and coding generally. I'm using a great tool called the Universal Reddit Scraper (https://github.com/JosephLai241/URS) to pull some reddit data. It allows you to scrape subreddits, among other things. It creates a CSV file with list of submissions in a given subreddit with each one's ID as a column.
-
Tools for downloading Reddit user profiles and subreddits?
Because I'm not sure this guy does everything you want https://github.com/JosephLai241/URS
-
Wordcloud /r/suomi all-time Top100 postauksista
Toteutettu Universal Reddit Scraperillä.
- My issue with the Transgender_Surgeries Wiki - and how I propose to solve this issue
What are some alternatives?
kdl - the kdl document language specifications
asyncpraw - Async PRAW, an abbreviation for "Asynchronous Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
LIBUCL - Universal configuration library parser
reddit-analyzer - Simple python script to analyze reddit accounts
prometheus-operator - Prometheus Operator creates/configures/manages Prometheus clusters atop Kubernetes
RedditDownloader - Scrapes Reddit to download media of your choice.
Reddit-Crawler - Crawls for all posts and link comments from a specfic user and posts them to a specific subreddit. Utilizes PRAW and attempts to prevent reposts
redditcoins-backend - Pull reddit data from APIs and store it in local db
whatsapp-osint - WhatsApp spy - logs online/offline events from ANYONE in the world
reddit-auto-poster.py - Python script for posting to multiple subreddits automagically.
JobFunnel - Scrape job websites into a single spreadsheet with no duplicates.
meme-videos - scrapes memes and turn them into a video compilations