[D] Discussion about fine tuning language models for generating SQL queries

• picard

  6 322 0.0 Haskell

  PICARD - Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models. PICARD is a ServiceNow Research project that was started at Element AI. (by ServiceNow)

  

Hi, author of PICARD here. Your idea of fine-tuning a model like GPT or T5 on the text2sql task makes sense, this is literally what I did in the PICARD paper. I can recommend our GitHub repo, https://github.com/ElementAI/picard, where you can see how that was done. You will be quickly familiar with it, because the pipeline is based on huggingface’s transformers seq-to-seq examples.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project