The AI Reproducibility Crisis in GPT-3.5/GPT-4 Research

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
Benchmark chatgpt gpt-4 large-language-models program-synthesis

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • zero-shot-replication

    • *Further Reading*:

    - [GPT-4's decline over time (HackerNews)](https://news.ycombinator.com/item?id=36786407)

    - [GPT-4 downgrade discussions (OpenAI Forums)](https://community.openai.com/t/gpt-4-has-been-severely-downg...)

    - [Behavioral changes in ChatGPT (arXiv)](https://arxiv.org/abs/2307.09009)

    - [Zero-Shot Replication Effort (Github)](https://github.com/emrgnt-cmplxty/zero-shot-replication)

    - [Inconsistencies in GPT-4 HumanEval (Github)](https://github.com/evalplus/evalplus/issues/15)

    - [Early experiments with GPT-4 (arXiv)](https://arxiv.org/abs/2303.12712)

    - [GPT-4 Technical Report (arXiv)](https://arxiv.org/abs/2303.08774)

  • evalplus

    EvalPlus for rigourous evaluation of LLM-synthesized code

    • *Further Reading*:

    - [GPT-4's decline over time (HackerNews)](https://news.ycombinator.com/item?id=36786407)

    - [GPT-4 downgrade discussions (OpenAI Forums)](https://community.openai.com/t/gpt-4-has-been-severely-downg...)

    - [Behavioral changes in ChatGPT (arXiv)](https://arxiv.org/abs/2307.09009)

    - [Zero-Shot Replication Effort (Github)](https://github.com/emrgnt-cmplxty/zero-shot-replication)

    - [Inconsistencies in GPT-4 HumanEval (Github)](https://github.com/evalplus/evalplus/issues/15)

    - [Early experiments with GPT-4 (arXiv)](https://arxiv.org/abs/2303.12712)

    - [GPT-4 Technical Report (arXiv)](https://arxiv.org/abs/2303.08774)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Official WizardCoder-15B-V1.0 Released! Can Achieve 59.8% Pass@1 on HumanEval!

    5 projects | /r/LocalLLaMA | 15 Jun 2023

  • GPT 4 new limits only 40 messages in 3 days

    2 projects | /r/ChatGPT | 10 Dec 2023

  • ChatGPT needs its own desktop application

    1 project | /r/ChatGPT | 10 Dec 2023

  • GPT Message limit is lying?

    1 project | /r/OpenAI | 10 Dec 2023

  • Enhance Speed of AnkiBrain Addon

    1 project | /r/ankibrain | 6 Dec 2023