OpenAI is too cheap to beat

• OpenMoE

  8 1,194 8.6 Python

  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

I think the weird thing about this is that it's completely true right now but in X months it may be totally outdated advice.

For example, efforts like OpenMOE https://github.com/XueFuzhao/OpenMoE or similar will probably eventually lead to very competitive performance and cost-effectiveness for open source models. At least in terms of competing with GPT-3.5 for many applications.

Also see https://laion.ai/

I also believe that within say 1-3 years there will be a different type of training approach that does not require such large datasets or manual human feedback.

• laion.ai

  25 101 8.6 HTML
  

I think the weird thing about this is that it's completely true right now but in X months it may be totally outdated advice.

For example, efforts like OpenMOE https://github.com/XueFuzhao/OpenMoE or similar will probably eventually lead to very competitive performance and cost-effectiveness for open source models. At least in terms of competing with GPT-3.5 for many applications.

Also see https://laion.ai/

I also believe that within say 1-3 years there will be a different type of training approach that does not require such large datasets or manual human feedback.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• OpenPipe

  13 2,367 9.9 TypeScript

  Turn expensive prompts into cheap fine-tuned models

  

Eh, OpenAI is too cheap to beat at their own game.

But there are a ton of use-cases where a 1 to 7B parameter fine-tuned model will be faster, cheaper and easier to deploy than a prompted or fine-tuned GPT-3.5-sized model.

In fact, it might be a strong statement but I'd argue that most current use-cases for (non-fine-tuned) GPT-3.5 fit in that bucket.

(Disclaimer: currently building https://openpipe.ai; making it trivial for product engineers to replace OpenAI prompts with their own fine-tuned models.)

• tesseract-ocr

  120 58,022 8.9 C++

  Tesseract Open Source OCR Engine (main repository)

  

> Does android even have native OCR?

Tesseract? https://github.com/tesseract-ocr/tesseract

Suggest a related project