Gensim

Open-source projects categorized as Gensim
Edit details
Language: + Python + Jupyter Notebook
Topics: Fasttext Natural Language Processing NLP Machine Learning Word2vec
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 6 Gensim Open-Source Projects

  • gensim

    Topic Modelling for Humans

    • Project mention: Aggregating news from different sources | /r/learnprogramming | 2023-07-08

  • magnitude

    A fast, efficient universal vector embedding utility package.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Fast_Sentence_Embeddings

    Compute Sentence Embeddings Fast!

    • Project mention: The Illustrated Word2Vec | news.ycombinator.com | 2024-04-19

    This is a great guide.

    Also - despite the fact that language model embedding [1] are currently the hot rage, good old embedding models are more than good enough for most tasks.

    With just a bit of tuning, they're generally as good at many sentence embedding tasks [2], and with good libraries [3] you're getting something like 400k sentence/sec on laptop CPU versus ~4k-15k sentences/sec on a v100 for LM embeddings.

    When you should use language model embeddings:

    - Multilingual tasks. While some embedding models are multilingual aligned (eg. MUSE [4]), you still need to route the sentence to the correct embedding model file (you need something like langdetect). It's also cumbersome, with one 400mb file per language.

    For LM embedding models, many are multilingual aligned right away.

    - Tasks that are very context specific or require fine-tuning. For instance, if you're making a RAG system for medical documents, the embedding space is best when it creates larger deviations for the difference between seemingly-related medical words.

    This means models with more embedding dimensions, and heavily favors LM models over classic embedding models.

    1. sbert.net

    2. https://collaborate.princeton.edu/en/publications/a-simple-b...

    3. https://github.com/oborchers/Fast_Sentence_Embeddings

    4. https://github.com/facebookresearch/MUSE

  • concise-concepts

    This repository contains an easy and intuitive approach to few-shot NER using most similar expansion over spaCy embeddings. Now with entity scoring.

  • japanese-words-to-vectors

    Word2vec (word to vectors) approach for Japanese language using Gensim and Mecab.

  • cusim

    Superfast CUDA implementation of Word2Vec and Latent Dirichlet Allocation (LDA)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Gensim related posts

Index

What are some of the best open-source Gensim projects? This list will help you:

Project Stars
1 gensim 15,273
2 magnitude 1,612
3 Fast_Sentence_Embeddings 603
4 concise-concepts 242
5 japanese-words-to-vectors 83
6 cusim 40

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com