[D] Is all the talk about what GPT can do on Twitter and Reddit exaggerated or fairly accurate?

• JARVIS

  52 23,019 7.2 Python

  JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

  

https://github.com/microsoft/JARVIS this has that capability as far as I know, I don’t know the individual hugging face model it utilizes for whatever task because there are a ton

• guardrails

  13 3,284 9.9 Python

  Adding guardrails to large language models.

  

not vouching for it, but I know this is at least a thing that exists and I like the general idea: https://github.com/shreyar/guardrails

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• TruthfulQA

  4 499 2.8 Jupyter Notebook

  TruthfulQA: Measuring How Models Imitate Human Falsehoods

I agree they show that you can brute-force mimick uncertainty estimates to some degree, and that the model is generally well calibrated (though on what is basically a set of trivia questions, so YMMV)... yet:

Suggest a related project