BooookScore
xgen
BooookScore | xgen | |
---|---|---|
1 | 2 | |
72 | 713 | |
- | 0.6% | |
7.0 | 7.0 | |
about 2 months ago | 5 months ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
BooookScore
-
Evaluating faithfulness and content selection of LLMs in book-length summaries
With a link to https://arxiv.org/pdf/2310.00785.pdf - which then links to another GitHub repository, https://github.com/lilakk/BooookScore which has a bunch of prompts in https://github.com/lilakk/BooookScore/tree/main/prompts
Which makes me think that this original paper isn't evaluating LLMs so much as it's evaluating that one particular prompting technique for long summaries.
Gemini Pro 1.5 has 1m token context length, which should remove the need for weird hierarchical summary tricks. I wonder how well it would score?
xgen
- FLaNK Stack for 4th of July
-
AI — weekly megathread!
Salesforce AI Research released XGen-7B, a new open-source 7B LLM trained on 8K input sequence length for 1.5T tokens [Details| Huggingface| GitHub].
What are some alternatives?
background-removal-js - Remove backgrounds from images directly in the browser environment with ease and no additional costs or privacy concerns. Explore an interactive demo.
evernote-ai-chatbot
FastSAM - Fast Segment Anything
papyrus - A simple paper backup tool for GnuPG or SSH keys
chathn - Chat with Hacker News using natural language. Built with OpenAI Functions and Vercel AI SDK.
configu - Open-source ConfigOps infrastructure ⚙️
DragGAN - Official Code for DragGAN (SIGGRAPH 2023)
generative-models - Generative Models by Stability AI
parquet-format - Apache Parquet
gocontracts - A tool for design-by-contract in Go
agents - An Open-source Framework for Autonomous Language Agents
generic - flexible data type for Go