[P] Fine-tuning LLaMA on TheVault by AI4Code

• TheVault

  4 78 7.9 Jupyter Notebook

  [EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation

  

I essentially want to fine-tune LLaMA on a dataset that's geared towards code generation. After a bit of research I found TheVault which seems good enough for the job (let me know if there are better datasets tho).

• qlora

  80 9,388 7.4 Jupyter Notebook

  QLoRA: Efficient Finetuning of Quantized LLMs

github https://github.com/artidoro/qlora

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project