Serendipity
chardet
Serendipity | chardet | |
---|---|---|
3 | 8 | |
198 | 2,076 | |
1.5% | 0.9% | |
8.4 | 2.9 | |
5 days ago | 6 months ago | |
PHP | Python | |
BSD 3-clause "New" or "Revised" License | GNU Lesser General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Serendipity
-
Is it possible to create an RSS feed from a github page?
For a public repo the URL for the (Atom, not RSS) commit feed is org/repo/commits/master.atom, for example https://github.com/s9y/Serendipity/commits/master.atom for https://github.com/s9y/Serendipity. See https://github.community/t/rss-feeds-for-github-projects/292.
-
In MySQL, never use “utf8”. Use “utf8mb4”
https://github.com/s9y/Serendipity/blob/05f58f90d743fe9ade24... is just the detection function I wrote for a PHP blog engine to detect whether it would even be possible to use utf8mb4 on the system. We completely ran into this issue and didn't know how to handle it for literally years. Lots of blogs to migrate, and who knows whether it worked for all of them...
-
Chrome testing RSS-powered ‘Follow’ button
In addition to the answers you got refuting load as a problem: "Last updated since" headers are indeed a thing. Look for example at how RSS gets cached in wordpress [0] or the classical blog engine serendipity [1]. Also, push instead of pull is also common. Made popular for feeds by pubsubhubbub, since enterprise-ready renamed to WebSub [2]. Readers like bazqux do support that.
[0]: https://github.com/WordPress/WordPress/blob/270f2011f8ec7265...
[1]: https://github.com/s9y/Serendipity/blob/e2044472c202a8368774...
[2]: https://en.wikipedia.org/wiki/WebSub
chardet
- After almost a year, Ben Eater is back
-
3 Ways to Handle non UTF-8 Characters in Pandas
chardet is a library for decoding characters, once installed you can use the following to determine encoding:
-
In MySQL, never use “utf8”. Use “utf8mb4”
The craziest issue I had was I couldn't predict what char encoding the text in my database was in. Most users entered Windows-1252, some text blobs were UTF-16, others were European character sets, and some were UTF-8. Some were Japanese SHIFT_JIS. Don't ask me how any of this happened. I retrospect, I should have dumped all the tables from MySQL and used the excellent PyPy Chardet [1] library to see what I was dealing with, do the conversions and then re-import the data. But then someone could copy UTF-16 from a Windows document and paste it in, so you have to convert going in to the database.
You have set Apache to UTF-8, PHP to UTF-8, MySQL to UTF-8, and the MySQL driver you are using to UTF-8. It's not clear how these setting interact. Are there silent conversions happening or do you always have to detect the encoding on data coming from the server? HTML pages have a character encoding specifier, but the BOM at the start of the file takes precedence (I think.) I got it to work by always detecting encoding for any text coming from the database and using iconv, but this turned out to be really slow and unreliable. It was truly the biggest mess by an order of magnitude than any other programming problem I faced in my career.
Would not attempt again.
[1] https://github.com/chardet/chardet
-
Encoding detection
I found there is a https://github.com/chardet/chardet python library, which can be ported to Common Lisp.
-
How to convert cmd output to UTF-8
Then use chardet to determine the encoding from the content
-
Everything to know about Requests v2.26.0
The library that Requests uses for content encoding detection has for the past 10 years been chardet which is licensed LGPL-2.1.
- PyWhat: Identify Anything
- UTF-8 is not enough? Requesting help with an open source project!
What are some alternatives?
laravel-commonmark-blog - A simple filesystem-based, SEO-optimized blog for Laravel using CommonMark.
Charset Normalizer - Truly universal encoding detector in pure Python
Luminosity - Luminosity – a modern style blogging platform
fuzzywuzzy - Fuzzy String Matching in Python
TravianZ - Travian T3.6 Clone in PHP
ftfy - Fixes mojibake and other glitches in Unicode text, after the fact.
WordPress - WordPress, Git-ified. This repository is just a mirror of the WordPress subversion repository. Please do not send pull requests. Submit pull requests to https://github.com/WordPress/wordpress-develop and patches to https://core.trac.wordpress.org/ instead.
Levenshtein - The Levenshtein Python C extension module contains functions for fast computation of Levenshtein distance and string similarity
RSS-Bridge - The RSS feed for websites missing it
shortuuid - A generator library for concise, unambiguous and URL-safe UUIDs.
docker-postgres-upgrade - a PoC for using "pg_upgrade" inside Docker -- learn from it, adapt it for your needs; don't expect it to work as-is!
pyfiglet - An implementation of figlet written in Python