hate-speech-and-offensive-language
100daysofpractice-dataset
| hate-speech-and-offensive-language | 100daysofpractice-dataset | |
|---|---|---|
| 2 | 1 | |
| 779 | 0 | |
| - | - | |
| 1.9 | 0.0 | |
| over 1 year ago | about 2 years ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | Creative Commons Zero v1.0 Universal |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
hate-speech-and-offensive-language
-
How to make a class column for a classifier from sentiment analysis results?
I've used NRCLex to perform sentiment analysis on some Twitter data. I have hate speech classifier code (https://github.com/t-davidson/hate-speech-and-offensive-language/blob/master/classifier/final_classifier.ipynb) I want to pass the dataset through, but before I can I need to have a "class" column for the model. For those not familiar, NRCLex returns scores for 10 emotions: anticipation, joy, anger, fear, surprise, disgust, positive, negative, sadness and trust. The table looks like this (letters denoting emotions):
-
Where do we go from here and who is going to step up to help us?
Some of this exists, and both Quora and Facebook (among others) use it extensively. Both hate speech and porn are good targets for machine learning. It needs supervision, but it can take a lot of load off human moderators.
Open source implementations exist, e.g.:
https://github.com/t-davidson/hate-speech-and-offensive-lang...
I suspect more message board will want to start applying these sooner rather than later. Most have already figured out that they need anti-spam tools, rather than it coming as a surprise when they roll things out and it fills up with bots. The technology is similar.
You mention being able to share that information across boards, and I don't know of any widespread implementation of that. You can, at least, let somebody else handle your authentication, which slightly slows their ability to create new accounts when you blacklist one. I'd like to see those sites distinguish "aged" accounts, so that it at least takes some effort or cost to use a new account.
100daysofpractice-dataset
-
#100daysofpractice: Hilary Hahn’s creation, inspiration, and the impact on practice during the pandemics
Oh thanks!! Super glad you like it! :)) You can also play with the Python Notebook on Google Colab or download the dataset if you are curious!!
What are some alternatives?
hashformers - Hashformers is a framework for hashtag segmentation with Transformers and Large Language Models (LLMs).
mac-miller-lyrics-dataset - Dataset with lyrics from Mac Miller
Tegridy-MIDI-Dataset - Tegridy MIDI Dataset for precise and effective Music AI models creation.
whylogs - An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
toxicity - The world's largest social media toxicity dataset.
datasets - 🎁 5,400,000+ Unsplash images made available for research and machine learning
cia - 🐱💻 CIA Factbook data analysis and dataset reconstruction, modification, and tuning go here.
covid-chestxray-dataset - We are building an open database of COVID-19 cases with chest X-ray or CT images.
PLOD-AbbreviationDetection - This repository contains the PLOD Dataset for Abbreviation Detection released with our LREC 2022 publication
instagram-scraping-fish - A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com
ThoughtSource - A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/
OpenFilter - This repository refers to the paper currently under review for the 36th Conference on Neural Information Processing Systems (NeurIPS 2022) Track on Datasets and Benchmarks, under the title "OpenFilter: A Framework to Democratize Research Access to Social Media AR Filters", by Piera Riccio, Bill Psomas, Francesco Galati, Francisco Escolano, Thomas Hofmann and Nuria Oliver.