FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation" (by shmsw25)

FActScore Alternatives

Similar projects and alternatives to FActScore based on common topics and language

  1. RefChecker

    RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. long-form-factuality

    Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

  4. OpenFactVerification

    Loki: Open-source solution designed to automate the process of verifying factuality

  5. WikiChat

    1 FActScore VS WikiChat

    WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.

  6. RL4LMs

    5 FActScore VS RL4LMs

    A modular RL library to fine-tune language models to human preferences

  7. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better FActScore alternative or higher similarity.

FActScore discussion

Log in or Post with

FActScore reviews and mentions

Posts with mentions or reviews of FActScore. We have used some of these posts to build our list of alternatives and similar projects.
  • Long-form factuality in large language models
    1 project | news.ycombinator.com | 6 Apr 2024
    Looks like a slight modification of FActScore [1], but instead of using Wikipedia as a verification source, they use Google Search. They also claim to include a wider range of topics. That said, FActScore allows you to use whatever knowledge source and topics you want [2].

    [1]: https://arxiv.org/abs/2305.14251

    [2]: https://github.com/shmsw25/FActScore?tab=readme-ov-file#to-u...

Stats

Basic FActScore repo stats
1
359
3.3
3 months ago

shmsw25/FActScore is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of FActScore is Python.


Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?