starcoder VS JLine

Use local LLM like: https://github.com/bigcode-project/starcoder

Here's the script I use to merge a LoRA onto a base model: https://gist.github.com/TheBloke/d31d289d3198c24e0ca68aaf37a19032 (a slightly modified version of https://github.com/bigcode-project/starcoder/blob/main/finetune/merge_peft_adapters.py)

consult: https://github.com/bigcode-project/starcoder/issues/6 https://huggingface.co/bigcode/starcoder/discussions/12

StarCoder - The biggest open source code LLM. It’s a free VS code extension. Looks great for coding, makes you wonder how long things like Github Copilot and Ghostwriter can afford to charge when we have open source building things like this. Link to github [Link] Link to HF [Link]

Outside of just using GPT4, which works well, this is supposedly the solution, though I haven't tried it just yet. starcoder/README.md at main · bigcode-project/starcoder · GitHub

GitHub link: https://github.com/bigcode-project/starcoder/tree/main

If you wanted to give writing a CLI a go yourself from scratch, I recommend searching for Java solutions first. Kotter itself is built on top of https://github.com/jline/jline3

I sit on top of JLine at the very bottom.

Unfortunately, It doesn't work with Intellij terminalsee this issue

Right now REPLy is kind of stuck and it needs to be updated to the latest version of JLine eventually (https://github.com/jline/jline3).

thanks for the reply, we;ve found the jlines library https://github.com/jline/jline3. it has key bindings for key events and a non blocking line reader, but now im stuck on changing it to blocking to read lines in ! for data entry ! thank you again.

[1] https://github.com/jline/jline3