Top 10 C++ Natural Language Processing Projects

sentencepiece

19 9,451 8.3 C++

Unsupervised text tokenizer for Neural Network-based text generation.

Project mention: sentencepiece | news.ycombinator.com | 2023-12-11

openvino

17 5,911 10.0 C++

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
MITIE

0 2,892 0.0 C++

MITIE: library and tools for information extraction
hunspell

20 2,002 7.7 C++

The most popular spellchecking library.

Project mention: Is GNU Aspell the best spell checker for emacs on macOS? | /r/emacs | 2023-05-23

Hunspell seems popular as well. I believe it's the one used by Firefox and LibreOffice, and I think it's the system spell checker in MacOS already? 🤷‍♂️

TextGrocery

0 680 0.0 C++

A simple short-text classification tool based on LibLinear
nuspell

2 206 4.5 C++

🖋️ Fast and safe spellchecking C++ library

Project mention: Is GNU Aspell the best spell checker for emacs on macOS? | /r/emacs | 2023-05-23

Another option is Nuspell.

BTM

1 88 0.0 C++

Biterm Topic Modelling for Short Text with R (by bnosac)
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
FLARE

2 10 6.1 C++

C++ Neural Network Library (by rkuang9)
Recognition-of-logical-document-structures

2 5 0.0 C++

First approach for recognizing logical document structures like texts, sentences, segments, words, chars and sentence/segment depth based on recurrent neural network grammars.
Text_frequency_research

2 1 7.2 C++

Developing language frequency lists from Reddit/Twitter posts and Wikipedia articles

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Natural Language Processing related posts

sentencepiece
1 project | news.ycombinator.com | 11 Dec 2023
[P] TokenMonster Ungreedy ~ 35% faster inference and 35% increased context-length for large language models (compared to tiktoken). Benchmarks included.
2 projects | /r/MachineLearning | 4 Jun 2023
LLaMA tokenizer: is a JavaScript implementation available anywhere?
1 project | /r/LocalLLaMA | 27 May 2023
[P] New tokenization method improves LLM performance & context-length by 25%+
2 projects | /r/MachineLearning | 13 May 2023
Code runs without definition of function (automatically calls a different function instead)
2 projects | /r/learnpython | 27 Mar 2023
How to handle multiple languages in a sentence?
1 project | /r/deeplearning | 22 Mar 2023
Why don't common browsers use Soundex for spelling suggestions?
1 project | /r/browsers | 6 Mar 2023
A note from our sponsor - WorkOS
workos.com | 26 Apr 2024

The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Index

What are some of the best open-source Natural Language Processing projects in C++? This list will help you:

	Project	Stars
1	sentencepiece	9,451
2	openvino	5,911
3	MITIE	2,892
4	hunspell	2,002
5	TextGrocery	680
6	nuspell	206
7	BTM	88
8	FLARE	10
9	Recognition-of-logical-document-structures	5
10	Text_frequency_research	1