Python factuality

Open-source Python projects categorized as factuality
Edit details
Topics: Language language-modeling Evaluation large-language-models hallucination
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 3 Python factuality Projects

  • OpenFactVerification

    Loki: Open-source solution designed to automate the process of verifying factuality

    • Project mention: Show HN: Loki Needs You – Collaborate on an Open-Source Fact-Checking AI | news.ycombinator.com | 2024-04-16

  • long-form-factuality

    Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

    • Project mention: An Open Source Tool for Multimodal Fact Verification | news.ycombinator.com | 2024-04-06

    Isn't this similar to the Deepmind paper on long form factuality posted a few days ago?

    https://arxiv.org/abs/2403.18802

    https://github.com/google-deepmind/long-form-factuality/tree...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • FActScore

    A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

    • Project mention: Long-form factuality in large language models | news.ycombinator.com | 2024-04-06

    Looks like a slight modification of FActScore [1], but instead of using Wikipedia as a verification source, they use Google Search. They also claim to include a wider range of topics. That said, FActScore allows you to use whatever knowledge source and topics you want [2].

    [1]: https://arxiv.org/abs/2305.14251

    [2]: https://github.com/shmsw25/FActScore?tab=readme-ov-file#to-u...

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python factuality related posts

  • Show HN: Loki Needs You – Collaborate on an Open-Source Fact-Checking AI

    1 project | news.ycombinator.com | 16 Apr 2024

  • An Open Source Tool for Multimodal Fact Verification

    7 projects | news.ycombinator.com | 6 Apr 2024

Index

What are some of the best open-source factuality projects in Python? This list will help you:

Project Stars
1 OpenFactVerification 883
2 long-form-factuality 447
3 FActScore 217

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com