OCTIS VS BERTopic

OCTIS

My team and I have recently released a python library called OCTIS (https://github.com/mind-Lab/octis) that allows you to automatically optimize the hyperparameters of a topic model according to a given evaluation metric (not log-likelihood). I guess, in your case, you might be interested in topic coherence. So you will get good quality topics with a low effort on the choice of the hyperparameters. Also, we included some state-of-the-art topic models, e.g. contextualized topic models (https://github.com/MilaNLProc/contextualized-topic-models).

I recently released a topic modeling library that also includes different evaluation measures. If you are interested, I leave here the link: https://github.com/mind-Lab/octis

Silvia Terragni (a coauthor on the above) also brought a topic modelling library OCTIS which was exhibited as a demo paper and aims to be the huggingface transformers of topic modelling - it includes wrappers around the above model as well as and LDA and some baselines as well as some tools and frameworks for comparing them.

Link to the code Paper

Try experimenting with different hyperparameters, clustering algorithms and embedding representations. Try https://github.com/MaartenGr/BERTopic/tree/master/bertopic

Try out this notebook which comes with the BERTopic repository.

After some googling, I found this (but for M1 chip Mac) --I wonder if I'm stuck. Is this laptop just not up for the job of working with sentence transformers? Appreciate your advice

Most has already been said and I am not sure how relevant this is but since you are focusing on human raters it might be worthwhile to mention that there is a Pull Request in BERTopic that allows you to use models on top of the default pipeline that further fine-tunes the topic representation. In theory, this would allow you to even use ChatGPT or any of the other OpenAI models to label the topics. From a human annotator perspective, this might be interesting to pursue.

The BERTopic library allows you to plug and play any type of embedding.

A number of excellent topic modeling libraries exist in Python today. BERTopic and Top2Vec are two of the most popular. Both use sentence-transformers to encode data into vectors, UMAP for dimensionality reduction and HDBSCAN to cluster nodes.

BERTopic is a library to consider if you want something that groups data by topic.

I have experimented a bit with BERTopic but didn't find the results very useful. The issue is, that it is very important what exactly people are liking or disliking about the products, not just the fact that they are talking about specific aspects.