Refact LLM: New 1.6B code model reaches 32% HumanEval and is SOTA for the size

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • ctransformers

    Python bindings for the Transformer models implemented in C/C++ using GGML library.

  • Does ctransformer (https://github.com/marella/ctransformers#supported-models) support running refact?

    I see that model type "gpt_refact" in https://huggingface.co/smallcloudai/Refact-1_6B-fim/blob/mai...

  • jsonformer

    A Bulletproof Way to Generate Structured JSON from Language Models

  • - Tools like jsonformer https://github.com/1rgs/jsonformer are not possible with OpenAIs API.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • WizardLM

    Discontinued Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath

  • This is interesting work, and a good contribution, but there is no need to mislead people.

    [1] https://github.com/nlpxucan/WizardLM

  • blog

    Public repo for HF blog posts (by huggingface)

  • [4] https://github.com/huggingface/blog/blob/main/starcoder.md

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts