smartcat
godot-dodo
| smartcat | godot-dodo | |
|---|---|---|
| 1 | 16 | |
| 3 | 510 | |
| - | - | |
| 6.4 | 3.1 | |
| 8 months ago | about 1 year ago | |
| JavaScript | Python | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
smartcat
godot-dodo
-
Meta: Code Llama, an AI Tool for Coding
If you can find a large body of good, permissively licensed example code, you can finetune an LLM on it!
There was a similar attempt for Godot script trained a few months ago, and its reportedly pretty good:
https://github.com/minosvasilias/godot-dodo
I think more attempts havent been made because base llama is not that great at coding in general, relative to its other strengths, and stuff like Starcoder has flown under the radar.
-
[P] godot-dodo – Finetuning starcoder on single-language instruction data
This a continuation of previous work done for the godot-dodo project, which involved finetuning LLaMA models on GitHub-scraped GDScript code.
-
Godot-Dodo – Finetuning starcoder on single-language instruction data
This a continuation of previous work done in the godot-dodo project (https://github.com/minosvasilias/godot-dodo), which involved finetuning LLaMA models on GitHub-scraped GDScript code.
Starcoder performs significantly better than LLaMA using the same dataset, and exceeds evaluation scores of both gpt-4 and gpt-3.5-turbo, showing that single-language finetunes of smaller models may be a competitive option for coding assistants, especially for less commonplace languages such as GDScript.
The twitter thread also details some drawbacks of the current approach, namely increasing occurences where the model references out-of-scope objects in its generated code, a problem that worsens as the amount of training epochs increases.
-
Has anyone got this running in Godot?
Not exactly what your looking for, but related: https://github.com/minosvasilias/godot-dodo
- Possible to train GPT on a custom scripting language?
- Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs
What are some alternatives?
lmdeploy - LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ollama-ui - Simple HTML UI for Ollama
godot-copilot - AI-assisted development for the Godot engine.
codellama - Inference code for CodeLlama models
lit-llama - Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
ggml - Tensor library for machine learning
refact - WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
llama-cpp-python - Python bindings for llama.cpp
ArchGPT - 🐕 ArchGPT is a source-code-management framework to enable a new meta-programming paradigm specially designed for Language-Model-Driven-Development (LMDD) i.e. the utilization of Large Language Models for automated software development.
llama.cpp - LLM inference in C/C++