Python character encoding detector (by chardet)

Chardet Alternatives

Similar projects and alternatives to chardet

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better chardet alternative or higher similarity.

chardet reviews and mentions

Posts with mentions or reviews of chardet. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-11-05.
  • After almost a year, Ben Eater is back
    2 projects | | 5 Nov 2022
  • In MySQL, never use “utf8”. Use “utf8mb4”
    8 projects | | 12 Jan 2022
    The craziest issue I had was I couldn't predict what char encoding the text in my database was in. Most users entered Windows-1252, some text blobs were UTF-16, others were European character sets, and some were UTF-8. Some were Japanese SHIFT_JIS. Don't ask me how any of this happened. I retrospect, I should have dumped all the tables from MySQL and used the excellent PyPy Chardet [1] library to see what I was dealing with, do the conversions and then re-import the data. But then someone could copy UTF-16 from a Windows document and paste it in, so you have to convert going in to the database.

    You have set Apache to UTF-8, PHP to UTF-8, MySQL to UTF-8, and the MySQL driver you are using to UTF-8. It's not clear how these setting interact. Are there silent conversions happening or do you always have to detect the encoding on data coming from the server? HTML pages have a character encoding specifier, but the BOM at the start of the file takes precedence (I think.) I got it to work by always detecting encoding for any text coming from the database and using iconv, but this turned out to be really slow and unreliable. It was truly the biggest mess by an order of magnitude than any other programming problem I faced in my career.

    Would not attempt again.


  • Encoding detection
    5 projects | | 24 Nov 2021
    I found there is a python library, which can be ported to Common Lisp.
  • Everything to know about Requests v2.26.0
    5 projects | | 13 Jul 2021
    The library that Requests uses for content encoding detection has for the past 10 years been chardet which is licensed LGPL-2.1.
  • PyWhat: Identify Anything
    8 projects | | 16 Jun 2021
  • A note from our sponsor - #<SponsorshipServiceOld:0x00007f160f937a20> | 22 Mar 2023
    SaaSHub helps you find the best software and product alternatives Learn more →


Basic chardet repo stats
4 months ago
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives