detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at [email protected]. (by unitaryai)

Detoxify Alternatives

Similar projects and alternatives to detoxify

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better detoxify alternative or higher similarity.

detoxify reviews and mentions

Posts with mentions or reviews of detoxify. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-11-10.
  • ML Discord Moderation Bot
    1 project | /r/DiscordModeration | 2 Aug 2022
    I created a small discord moderation bot, src can be found at https://gist.github.com/KrautByte/975f404969f4de8f4147e1bb4f7b64cb using https://github.com/unitaryai/detoxify
  • Cedille, the largest French language model , released in open source
    4 projects | /r/france | 10 Nov 2021
  • Show HN: Cedille, the largest French language model, released in open source
    3 projects | news.ycombinator.com | 10 Nov 2021
    Yeah, this kind of toxic output sadly still can happen :-/

    We have fully analyzed the training dataset (1128 GB) using Detoxify (https://github.com/unitaryai/detoxify) to filter out problematic content. But of course detecting toxicity is a tough challenge in itself, so this process is imperfect at best.

    We are using the RealToxicityPrompt framework (https://realtoxicityprompts.apps.allenai.org/) to analyse how toxic our models are and to steer our efforts in this direction. This means we are generating thousands of completions and analysing them to see how "nasty" the model is. We plan to write more on this topic soon.

    But yeah, this is definitely far from being a solved problem, and our model (as well as all large language models) should be handled with care.

  • Implementing a toxicity detector in your chatbots
    5 projects | dev.to | 25 Mar 2021
    Detoxify is the result of three Kaggle competitions proposed to improve toxicity classifiers. Each had a different purpose within the toxicity classifiers context.
  • A note from our sponsor - WorkOS
    workos.com | 24 Apr 2024
    The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Stats

Basic detoxify repo stats
4
836
6.2
14 days ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com