umap VS utterances

UMAP GitHub repository: https://github.com/lmcinnes/umap

Uniform Manifold Approximation and Projection (UMAP) is a well-known dimensionality reduction method along with t-SNE.

A number of excellent topic modeling libraries exist in Python today. BERTopic and Top2Vec are two of the most popular. Both use sentence-transformers to encode data into vectors, UMAP for dimensionality reduction and HDBSCAN to cluster nodes.

As with anything, it depends on the problem. But T-SNE and UMAP are often good.

UMAP distances.py: umap/distances.py at master · lmcinnes/umap (github.com)

I used for this project Flask and OpenAI CLIP. For the vector search I used approximate nearest neighbors provided by spotify/annoy. I used Flask-SQLAlchemy with GeoAlchemy2 to query GPS coordinates. The embedding was done using UMAP.

side note: instead of t-SNE consider UMAP - provides better results (and it's much faster) https://github.com/lmcinnes/umap

Sounds like a job for UMAP https://github.com/lmcinnes/umap ?

I am a fairly experienced python developer/researcher (about 10 years), and have found a bug that breaks all of my intuitions. I am messing with the [UMAP](https://github.com/lmcinnes/umap) repository and trying to add the option to disable some additional features. I've stripped everything from it but have a [quick test that will run my UMAP version and compare the outputs with what the original gave](https://github.com/Andrew-Draganov/probabilistic_dim_reduction/blob/master/umap/nndescent_umap_test.py). Managing my random seeds, same inputs, all that.

I'm currently reading through a project on github, https://github.com/lmcinnes/umap, and in `umap/umap_.py` at line 2287, they have this:

Handling New Comments: There are excellent lightweight comment utilities available for managing comments on your eleventy blog. I personally use Utterances, but Giscus is also a great alternative.

We can use utteranc.es, a lightweight comment widget built on GitHub Issues to integrate authed comments in our blog.

utterances (open-source)

Typically, a comment requires server side code and a lot of messy management. It’s a pain. These comments rely on a tool called utterances. Utterances uses GitHub’s issue tracker which was designed to track bugs, as part of that it includes extensive comment and discussion capabilities. If an issue doesn’t exist, utterances will automatically create that issue for you. It created this issue for the comments in this page...

I've installed utterances on my GitHub repo. I've configured it and given it the appropriate permissions. At the end of setup, it provided me with an HTML script and the following instructions:

Fortunatly we have free, lightweight and efficient options to add comments in blog website or any website. I am talking about utteranc.es. A lightweight comments widget built on GitHub issues. Use GitHub issues for blog comments, wiki pages and more!

Go to https://utteranc.es and follow the instructions to set up the commenting system.

Giscus drew significant inspiration from utterances, which utilize an issue-based comment system instead of discussions. I experimented with utterances initially, but I found it less convenient due to its reliance on an issue tracker for conversational purposes.

If you're building a blog for developers, you can use a third-party commenting service that requires login with github, for example https://utteranc.es/