clean-discord
Cleaning discord data for NLP (by JEF1056)
pyreports
pyreports is a python library that allows you to create complex report from various sources (by MatteoGuadrini)
clean-discord | pyreports | |
---|---|---|
2 | 9 | |
22 | 97 | |
- | - | |
0.0 | 8.7 | |
over 2 years ago | 12 days ago | |
Python | Python | |
- | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
clean-discord
Posts with mentions or reviews of clean-discord.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Massive multi-turn conversational dataset based on cleaned discord data
Splitting up the data currently isn't in the plans yet; if someone (or you) could create a classifier (NOTE: please, please optimize it, the amount of data to process here is not trivial) to split the data into the relevant groups, go ahead and create a branch and pull request to https://github.com/JEF1056/clean-discord and hopefully I can do that for the next release, which is slated toward the end of the year. I can provide small snippets of some of the raw JSON data so you can understand how it's formatted.
-
[R] Massive multi-turn conversational dataset based on cleaned discord data
Included in the raw data are a lot of unwanted, non-language behaviors; these include massive blocks of code, bot commands, bot messages, ASCII art, messages with only images attached, messages containing only unicode (non-standard) spaces, etc. Other messages are considered "toxic", e.g. falling under the categories: toxic, obscene, threatening, insulting, or identity hate. The regex and cleaning code can be found here.
pyreports
Posts with mentions or reviews of pyreports.
We have used some of these posts to build our list of alternatives
and similar projects.
What are some alternatives?
When comparing clean-discord and pyreports you can also consider the following projects:
telewater - A telegram bot that applies watermark on images, gifs, and videos.
lol - A utility library for Python (It contains a JSON-based-database, argparse, some common datatypes, switch cases etc)
standards-and-practices - Standards and Practices for Bitwise Industries
vmam - VLAN Mac-address Authentication Manager
matchering - 🎚️ Open Source Audio Matching and Mastering
datasetGPT - A command-line interface to generate textual and conversational datasets with LLMs.
zen_knit - Zen-Knit is a formal (PDF), informal (HTML) report generator for data analyst and data scientist who wants to use python. RMarkdown Alternative for Python