Alternate approaches to TF-IDF?

• faiss

  71 28,308 9.4 C++

  A library for efficient similarity search and clustering of dense vectors.

  

FAISS works well https://github.com/facebookresearch/faiss

• KeyBERT

  5 3,229 6.1 Python

  Minimal keyword extraction with BERT

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• yake

  5 1,574 3.0 Python

  Single-document unsupervised keyword extraction

  

You can look for usage here: https://github.com/LIAAD/yake and there is also a reference section with publications for more details of how this works. From what I remember, each keyphrase candidate is assigned an aggregated score based on various features: position in the text, casing, frequency, surrounding text frequency...

• scattertext

  3 2,203 4.7 Python

  Beautiful visualizations of how language differs among document types.

Other suggestions: Take a look at Scattertext. Compare keywords to the problem of aspect extraction. I think an underutilized way to look at textual data when you have a single group of interest is the word-frequency-based odds ratio.

Suggest a related project