FActScore VS tape

Compare FActScore vs tape and see what are their differences.

FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation" (by shmsw25)
factuality Language language-modeling Evaluation emnlp2023
Source Code
arxiv.org
Suggest alternative
Edit details

tape

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (by songlab-cal)
Deep Learning protein-sequences protein-structure semi-supervised-learning Benchmark language-modeling Dataset Pytorch
Source Code
biorxiv.org
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
FActScore tape
1 1
219 620
- 0.0%
6.4 0.0
3 months ago over 1 year ago
Python Python
MIT License BSD 3-clause "New" or "Revised" License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

FActScore

Posts with mentions or reviews of FActScore. We have used some of these posts to build our list of alternatives and similar projects.
  • Long-form factuality in large language models
    1 project | news.ycombinator.com | 6 Apr 2024
    Looks like a slight modification of FActScore [1], but instead of using Wikipedia as a verification source, they use Google Search. They also claim to include a wider range of topics. That said, FActScore allows you to use whatever knowledge source and topics you want [2].

    [1]: https://arxiv.org/abs/2305.14251

    [2]: https://github.com/shmsw25/FActScore?tab=readme-ov-file#to-u...

tape

Posts with mentions or reviews of tape. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-05-30.

What are some alternatives?

When comparing FActScore and tape you can also consider the following projects:

protein-bert-pytorch - Implementation of ProteinBERT in Pytorch

fashion-mnist - A MNIST-like fashion product database. Benchmark :point_down:

beir - A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

evodiff - Generation of protein sequences and evolutionary alignments via discrete diffusion models

ProFET - ProFET: Protein Feature Engineering Toolkit for Machine Learning

text - Models, data loaders and abstractions for language processing, powered by PyTorch

pypdb - A Python API for the RCSB Protein Data Bank (PDB)

protein_bert

openfold - Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2

asap - Amino-Acid Sequence Annotation Predictor (ASAP)

ronin - RoNIN: Robust Neural Inertial Navigation in the Wild

tape vs protein-bert-pytorch tape vs fashion-mnist tape vs beir tape vs evodiff tape vs ProFET tape vs text tape vs pypdb tape vs protein_bert tape vs openfold tape vs asap tape vs ronin