Top 23 Python question-answering Projects

• haystack

  54 13,633 9.9 Python

  :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

  

Project mention: Release Radar • March 2024 Edition | dev.to | 2024-04-07

View on GitHub

• PaddleNLP

  2 11,423 9.8 Python

  👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• simpletransformers

  6 3,979 7.3 Python

  Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

• paper-qa

  10 3,608 8.7 Python

  LLM Chain for answering questions from documents with citations

Project mention: Oracle of Zotero: LLM QA of Your Research Library | news.ycombinator.com | 2023-11-26

Why does this post link to a renamed fork of Paper-QA (https://github.com/whitead/paper-qa) which has made zero changes and is 19 commits behind the original?

• llmware

  9 3,086 9.8 Python

  Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.

  

Project mention: More Agents Is All You Need: LLMs performance scales with the number of agents | news.ycombinator.com | 2024-04-06

I couldn't agree more. You should check out LLMWare's SLIM agents (https://github.com/llmware-ai/llmware/tree/main/examples/SLI...). It's focusing on pretty much exactly this and chaining multiple local LLMs together.

A really good topic that ties in with this is the need for deterministic sampling (I may have the terminology a bit incorrect) depending on what the model is indended for. The LLMWare team did a good 2 part video on this here as well (https://www.youtube.com/watch?v=7oMTGhSKuNY)

I think dedicated miniture LLMs are the way forward.

Disclaimer - Not affiliated with them in any way, just think it's a really cool project.

• FARM

  3 1,723 0.0 Python

  :house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

  

• Questgen.ai

  3 871 6.3 Python

  Question generation using state-of-the-art Natural Language Processing algorithms

Project mention: Yes/No style Question and Answer Generation | /r/learnpython | 2023-06-15

I have tried to do some searching for models but there don't seem to be ones that do what I am looking for. The closest I found was Questgen, but it only generated the questions and they, more often than, not did not make sense - especially for the types of questions I was looking to generate.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• primeqa

  5 698 8.8 Python

  The prime repository for state-of-the-art Multilingual Question Answering research and development.

  

Project mention: State-of-the-Art Multilingual Question Answering | /r/aiengineer | 2023-07-10

• llmflows

  1 615 8.6 Python

  LLMFlows - Simple, Explicit and Transparent LLM Apps

Project mention: Show HN: LLMFlows – LangChain alternative for explicit and transparent apps | news.ycombinator.com | 2023-07-29

• qagnn

  6 588 0.0 Python

  [NAACL 2021] QAGNN: Question Answering using Language Models and Knowledge Graphs 🤖

• fastT5

  5 540 0.0 Python

  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

• happy-transformer

  1 497 9.0 Python

  Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

• lumos

  4 406 8.9 Python

  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs" (by allenai)

  

Project mention: Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs | news.ycombinator.com | 2024-04-01

Guess you are looking for this - https://github.com/allenai/lumos/blob/main/README.md

• PIXIU

  6 399 9.0 Python

  This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).

  

Project mention: PIXIU: NEW Data - star count:172.0 | /r/algoprojects | 2023-08-15

• LinkBERT

  2 389 1.8 Python

  [ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links

• megabots

  16 335 6.9 Python

  🤖 State-of-the-art, production ready LLM apps made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵

• cherche

  12 311 4.4 Python

  Neural Search

Project mention: [P] Semantic search | /r/MachineLearning | 2023-05-08

If you are interested, you can check out the documentation here: https://github.com/raphaelsty/cherche

• tableQA

  6 284 2.6 Python

  AI Tool for querying natural language on tabular data.

• GenRead

  1 265 10.0 Python

  Code and Checkpoints for "Generate rather than Retrieve: Large Language Models are Strong Context Generators" in ICLR 2023.

• kiri

  12 240 3.2 Python

  Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models. (by kiri-ai)

  

• summarizepaper

  2 219 7.4 Python

  An AI-powered arXiv paper summarization website with a virtual assistant for answering questions.

• question_extractor

  1 181 7.3 Python

  Generate question/answer training pairs out of raw text.

• FinBERT-QA

  1 113 0.0 Python

  Financial Domain Question Answering with pre-trained BERT Language Model

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python question-answering related posts

• Generative AI Frameworks and Tools Every Developer Should Know!
  1 project | dev.to | 13 Dec 2023
• Best way to programmatically extract data from a set of .pdf files?
  1 project | /r/artificial | 9 Dec 2023
• Llama2 and Haystack on Colab
  2 projects | news.ycombinator.com | 21 Jul 2023
• Build with LLMs for production with Haystack – has 10k stars on GitHub
  2 projects | news.ycombinator.com | 17 Jul 2023
• Show HN: Haystack – Production-Ready LLM Framework
  1 project | news.ycombinator.com | 11 Jul 2023
• Show HN: "banks" Using Jinja as the basis of LLM prompt templating
  2 projects | news.ycombinator.com | 15 Jun 2023
• [Project] I built a template repo for quick prototyping of search pipelines with Haystack and Streamlit
  2 projects | /r/MachineLearning | 8 Jun 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 26 Apr 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!