Python huggingface-transformers

Open-source Python projects categorized as huggingface-transformers

Top 22 Python huggingface-transformer Projects

  • autolabel

    Label, clean and enrich text datasets with LLMs.

  • Project mention: NLP Research in the Era of LLMs | news.ycombinator.com | 2023-12-21

    Try this: https://github.com/refuel-ai/autolabel

    Then the main challenge just becomes prompt design, which can sometimes be nebulous for NLP annotation.

  • chronos-forecasting

    Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting

  • Project mention: Financial Market Applications of LLMs | news.ycombinator.com | 2024-04-20

    There were some developments using LLMs in the timeseries domain which caught my attention.

    I toyed with the Chronos forecasting toolkit [1], and the results were predictably off by wild margins [2]

    What really caught my eye though was the "feel" of the predicted timeseries -- this is the first time I've seen synthetic timeseries that look like the real thing. Stock charts have a certain quality to them, once you've been looking at them long enough, you can tell more often than not whether some unlabeled data is a stock price timeseries or not. It seems the chronos LLM was able to pick up on that "nature" of the price movement, and replicate it in its forecasts. Impressive!

    1: https://github.com/amazon-science/chronos-forecasting

    2: https://imgur.com/a/hTRQ38d

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • uform

    Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

  • Project mention: CatLIP: Clip Vision Accuracy with 2.7x Faster Pre-Training on Web-Scale Data | news.ycombinator.com | 2024-04-25

    question: any good on-device size image embedding models?

    tried https://github.com/unum-cloud/uform which i do like, especially they also support languages other than English. Any recommendations on other alternatives?

  • detoxify

    Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at [email protected].

  • Multimodal-Toolkit

    Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

  • transformers-bloom-inference

    Fast Inference Solutions for BLOOM

  • rellm

    Exact structure out of any language model completion.

  • Project mention: Run and create custom ChatGPT-like bots with OpenChat | news.ycombinator.com | 2023-06-07

    - https://github.com/r2d4/rellm

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • finetune-gpt2xl

    Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

  • local-llm-function-calling

    A tool for generating function arguments and choosing what function to call with local LLMs

  • Project mention: Tell HN: OpenAI still has a moat, it's called function calling and its API | news.ycombinator.com | 2024-02-21

    hello? https://github.com/rizerphe/local-llm-function-calling

  • amazon-sagemaker-local-mode

    Amazon SageMaker Local Mode Examples

  • Project mention: Debugging Python Code in Amazon SageMaker Locally Using Visual Studio Code and PyCharm: A Step-by-Step Guide | dev.to | 2023-11-15

    git clone https://github.com/aws-samples/amazon-sagemaker-local-mode/ cd amazon-sagemaker-local-mode/general_pipeline_local_debug python3 -m venv .venv source .venv/bin/activate pip install jupyter jupyter lab

  • quickai

    QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

  • monitors4codegen

    Code and Data artifact for NeurIPS 2023 paper - "Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context". `multispy` is a lsp client library in Python intended to be used to build applications around language servers.

  • Project mention: Show HN: Multilspy – A library to easily use language servers to analyze code | news.ycombinator.com | 2023-11-28
  • llm-client-sdk

    SDK for using LLM

  • Project mention: LLM-Client – Python library for seamless integration with LLMs | news.ycombinator.com | 2023-07-27
  • discus

    A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ

  • Project mention: an open source package helping developers generate data for LLMs | /r/mlops | 2023-08-02
  • tasknet

    Easy multi-task learning with HuggingFace Datasets and Trainer

  • Extracting-Training-Data-from-Large-Langauge-Models

    A re-implementation of the "Extracting Training Data from Large Language Models" paper by Carlini et al., 2020

  • QDrant-NLP

    QDrant-NLP

  • Deep-Punctuation-Corrector

    A simple streamlit based webapp to process text and correct punctuation built using "fullstop-punctuation-multilang-large" Model from Huggingface Transformers 🤗.

  • quick-deploy

    Optimize, convert and deploy machine learning models as fast inference API using Triton and ORT. Currently support Hugging Face transformers, PyToch, Tensorflow, SKLearn and XGBoost models.

  • falcongpt

    Simple GPT app that uses the falcon-7b-instruct model with a Flask front-end.

  • Project mention: Simple GPT app that uses the falcon-7b-instruct model with a Flask front-end. | /r/ChatGPT | 2023-06-22
  • fiftyone-image-captioning-plugin

    Caption images across your datasets with state of the art models from Hugging Face and Replicate!

  • Project mention: How to Cluster Images | dev.to | 2024-04-09

    Concept Modeling Techniques: the built-in concept modeling technique in this walkthrough uses GPT-4V and some light prompting to identify each cluster's core concept. This is but one way to approach an open-ended problem. Try using image captioning and topic modeling, or create your own technique!

  • AIdventure_Server

    The server on which connects AIdventure game.

  • Project mention: AIdventure - Community Report (AKA Devlog) of December 2023 | /r/LyaaaaaGames | 2023-12-08

    AIdventure is a text adventure game with an AI as a storyteller. No rules, no censorship, the only limit is your imagination, not someone else's. - Steam: https://store.steampowered.com/app/2114790/AIdventure/ - Itch: https://lyaaaaaaaaaaaaaaa.itch.io/aidventure - Twitter: https://twitter.com/LyaaaaaGames - Reddit: r/LyaaaaaGames - French Reddit: r/LyaaaaaGames_FR - Youtube: https://www.youtube.com/channel/UCY9ChpG4FdZEwMoiWOjsKoQ - Website: https://www.lyaaaaagames.com - Discord: https://discord.gg/mJGSkJ3mgT

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python huggingface-transformers related posts

  • CatLIP: Clip Vision Accuracy with 2.7x Faster Pre-Training on Web-Scale Data

    1 project | news.ycombinator.com | 25 Apr 2024
  • Multimodal Embeddings for JavaScript, Swift, and Python

    1 project | news.ycombinator.com | 25 Apr 2024
  • Show HN: UForm v2 Featuring Multimodal Matryoshka, Multimodal DPO, and ONNX

    1 project | news.ycombinator.com | 28 Mar 2024
  • UForm v1: Multimodal Chat in 1.5B Parameters

    1 project | news.ycombinator.com | 28 Dec 2023
  • NLP Research in the Era of LLMs

    3 projects | news.ycombinator.com | 21 Dec 2023
  • AIdventure - Community Report (AKA Devlog) of December 2023

    1 project | /r/LyaaaaaGames | 8 Dec 2023
  • AIdventure utilise un serveur (local) en Python pour faire fonctionner les IA. Pour les curieux, ce serveur est open source. Je vous invite donc à visiter la page Github et fork si vous souhaitez expérimenter.

    1 project | /r/LyaaaaaGames_FR | 25 Oct 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 4 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source huggingface-transformer projects in Python? This list will help you:

Project Stars
1 autolabel 1,782
2 chronos-forecasting 1,644
3 uform 885
4 detoxify 839
5 Multimodal-Toolkit 555
6 transformers-bloom-inference 548
7 rellm 488
8 finetune-gpt2xl 421
9 local-llm-function-calling 265
10 amazon-sagemaker-local-mode 229
11 quickai 162
12 monitors4codegen 108
13 llm-client-sdk 70
14 discus 62
15 tasknet 33
16 Extracting-Training-Data-from-Large-Langauge-Models 26
17 QDrant-NLP 11
18 Deep-Punctuation-Corrector 9
19 quick-deploy 6
20 falcongpt 5
21 fiftyone-image-captioning-plugin 5
22 AIdventure_Server 1

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com