Python Chinese

Open-source Python projects categorized as Chinese

Top 23 Python Chinese Projects

  • funNLP

    中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽车品牌词库、汽车零件词库、连续英文切割、各种中文词向量、公司名字大全、古诗词库、IT词库、财经词库、成语词库、地名词库、历史名人词库、诗词词库、医学词库、饮食词库、法律词库、汽车词库、动物词库、中文聊天语料、中文谣言数据、百度中文问答数据集、句子相似度匹配算法集合、bert资源、文本生成&摘要相关工具、cocoNLP信息抽取工具、国内电话号码正则匹配、清华大学XLORE:中英文跨语言百科知识图谱、清华大学人工智能技术系列报告、自然语言生成、NLU太难了系列、自动对联数据及机器人、用户名黑名单列表、罪名法务名词及分类模型、微信公众号语料、cs224n深度学习自然语言处理课程、中文手写汉字识别、中文自然语言处理 语料/数据集、变量命名神器、分词语料库+代码、任务型对话英文数据集、ASR 语音数据集 + 基于深度学习的中文

  • chinese-xinhua

    :orange_book: 中华新华字典数据库。包括歇后语,成语,词语,汉字。

  • LearnThisRepo.com

    Learn 300+ open source libraries for free using AI. LearnThisRepo lets you learn 300+ open source repos including Postgres, Langchain, VS Code, and more by chatting with them using AI!

  • Qwen

    The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

    Project mention: What the heck is so great about this model? | /r/SillyTavernAI | 2023-12-07

    Qwen: https://github.com/QwenLM/Qwen

  • GPT2-Chinese

    Chinese version of GPT2 training code, using BERT tokenizer.

  • pkuseg-python

    pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

  • Baichuan-7B

    A large-scale 7B pretraining language model developed by BaiChuan-Inc.

    Project mention: Baichuan 7B reaches top of LLM leaderboard for it's size (New foundation model 4K tokens) | /r/LocalLLaMA | 2023-06-17

    GitHub: baichuan-inc/baichuan-7B: A large-scale 7B pretraining language model developed by BaiChuan-Inc. (github.com)

  • 汉字拼音转换工具(Python 版)

    汉字转拼音(pypinyin)

    Project mention: Pinyin Character Sorting | /r/ChineseLanguage | 2023-07-09

    Could probably whip up a python script real quick with this library: https://github.com/mozillazg/python-pinyin. Probably need some extra logic to deal with heteronyms. Not sure what your goal is.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • Huatuo-Llama-Med-Chinese

    Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草(原名:华驼)模型仓库,基于中文医学知识的大语言模型指令微调

    Project mention: Local medical LLM | /r/LocalLLaMA | 2023-06-09

    Huatuo-Llama-Med-Chinese https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese

  • awesome-pretrained-chinese-nlp-models

    Awesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合

    Project mention: Tip for people who want to read Chinese non translated novels but can’t stand MTL | /r/MartialMemes | 2023-03-08
  • Baichuan2

    A series of large language models developed by Baichuan Intelligent Technology

    Project mention: Baichuan 2 | news.ycombinator.com | 2023-10-12
  • Chinese-CLIP

    Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

  • Baichuan-13B

    A 13B large language model developed by Baichuan Intelligent Technology

    Project mention: Baichuan IA de China | /r/techieHugui | 2023-07-22
  • ark-pixel-font

    Open source Pan-CJK pixel font / 开源的泛中日韩像素字体

  • DeepKE

    An Open Toolkit for Knowledge Graph Extraction and Construction published at EMNLP2022 System Demonstrations.

    Project mention: Would this method work to increase the memory of the model? Saving summaries generated by a 2nd model and injecting them depending on the current topic. | /r/LocalLLaMA | 2023-06-09
  • OFA

    Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

  • TencentPretrain

    Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

    Project mention: Fine-tuning Llama | /r/Oobabooga | 2023-03-13
  • ttskit

    text to speech toolkit. 好用的中文语音合成工具箱,包含语音编码器、语音合成器、声码器和可视化模块。

  • xpinyin

    Translate Chinese hanzi to pinyin (拼音) by Python, 汉字转拼音

  • rime-cantonese

    Rime Cantonese input schema | 粵語拼音輸入方案

    Project mention: How to type Jyutcitzi? 【RIME keyboard installation manual】? | /r/CantoneseScriptReform | 2023-12-07

    Please follow instructions at https://github.com/rime/rime-cantonese/wiki and https://github.com/rime/rime-cantonese/wiki/新手安裝教程 In a nutshell, download and install using the following files: Mac: mac-2021.05.16-installer.pkg Windows: windows-sfx-2021.05.16-installer.exe Linux: Download and run ibus-install.sh Please check to ensure that RIME Cantonese is properly installed before proceeding to Step 3.

  • Cornucopia-LLaMA-Fin-Chinese

    聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效的金融垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

    Project mention: Cornucopia-LLaMA-Fin-Chinese: NEW Textual - star count:263.0 | /r/algoprojects | 2023-07-31
  • DataCLUE

    DataCLUE: 数据为中心的NLP基准和工具包

  • cwg

    Chinese Worksheet Generator

  • unihan-etl

    Export UNIHAN's database to csv, json or yaml

  • WorkOS

    The modern API for authentication & user identity. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-12-07.

Python Chinese related posts

Index

What are some of the best open-source Chinese projects in Python? This list will help you:

Project Stars
1 funNLP 61,740
2 chinese-xinhua 10,388
3 Qwen 9,195
4 GPT2-Chinese 7,295
5 pkuseg-python 6,382
6 Baichuan-7B 5,532
7 汉字拼音转换工具(Python 版) 4,606
8 Huatuo-Llama-Med-Chinese 4,060
9 awesome-pretrained-chinese-nlp-models 3,839
10 Baichuan2 3,640
11 Chinese-CLIP 3,144
12 Baichuan-13B 2,896
13 ark-pixel-font 2,827
14 DeepKE 2,717
15 OFA 2,259
16 TencentPretrain 955
17 ttskit 938
18 xpinyin 803
19 rime-cantonese 483
20 Cornucopia-LLaMA-Fin-Chinese 481
21 DataCLUE 145
22 cwg 66
23 unihan-etl 50
The modern API for authentication & user identity.
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com