commandjobs VS llama.cpp

Was able to try out Glide last night (https://glide.agenticlabs.com/task/IqHd0RV) with an open source repo (https://github.com/nicobrenner/commandjobs) and really liked it

Pros: it was kinda easy to get started, and Glide was able to figure out something that ChatGPT hadn't, which made a big difference, because I was about to have to rewrite a bunch of code otherwise

Cons: some things were not very intuitive, the chatting window is small and it's hard to copy text and read things in a slightly longer conversation - also wish it would just ingest the repo and figure out what to include in the context by itself, the method/section searching/selecting is tricky to use

All in all I'm very excited about what Glide can do and look forward to seeing its evolution

Thank you for building such amazing tool

Hi HN! I recently built a cli tool that uses AI to find job matches for software engineers (https://github.com/nicobrenner/commandjobs)

Someone on HN suggested (https://news.ycombinator.com/user?id=azophy_2) I should host the application via SSH, so that anyone could just do: ssh commandjobs.com

I thought that was super cool, but after doing some googling, I can't find any good resources on how to host command line applications via ssh

Would really appreciate any links or information you could provide on how to do it

Thank you

Excellent, thank you so much for the links, it's super interesting

It should be pretty straightforward to create a scraper for one of those portals

If you feel like taking a crack at it, checkout the code of the Ask HN who's hiring scraper here: https://github.com/nicobrenner/commandjobs/blob/47b5c89402a3...

I added a comment under the Add Sources issue, to support Workday's career portals: https://github.com/nicobrenner/commandjobs/issues/23#issueco...

if you can compile stuff, then looking at llama.cpp (what ollama uses) is also interesting: https://github.com/ggerganov/llama.cpp

the server is here: https://github.com/ggerganov/llama.cpp/tree/master/examples/...

And you can search for any GGUF on huggingface

Yes, Metal seems to allow a maximum of 1/2 of the RAM for one process, and 3/4 of the RAM allocated to the GPU overall. There’s a kernel hack to fix it, but that comes with the usual system integrity caveats. https://github.com/ggerganov/llama.cpp/discussions/2182

For anyone interested in exploring this, llama.cpp has an example implementation here:

https://github.com/ggerganov/llama.cpp/tree/master/examples/...

Getting started with LLMs can be intimidating. In this tutorial we will show you how to fine-tune a large language model using LoRA, facilitated by tools like llama.cpp and KitOps.

well https://github.com/ggerganov/llama.cpp/issues/6849