llama2.f90 VS drishal

I'm mostly a python programmer, but I find a lot of the ML frameworks are overkill for what they actually do, especially for inference. Fortran is pretty close to numpy - it handles arrays natively including slicing and matmul instinsics, you don't have to worry about memory etc. But it compiles into something fast and lightweight much more easily than python. It's nothing you couldn't do in C but I think Fortran is better suited for linear algebra.

See also https://github.com/rbitr/llama2.f90 which is basically the same thing but for running llama models and has 16-bit and 4-bit options and a lot more optimization.

I clicked on this because of Fortran and it had nothing to do with it. It was more an advertisement for Mojo.

If anyone is interested in Fortran for AI, I am working on a Fortran LLM project: https://github.com/rbitr/llama2.f90

Location: Chandigarh, India

Remote: yes

Willing to relocate: no

Technologies: Linux, Nix/NixOS, docker, Django

Résumé/CV: https://github.com/drishal/drishal/blob/main/resume.org

Email: [email protected]

I have a solid background in Linux and Python, as well as working with frameworks and tools such as Django, Docker and Nix/NixOS. I am also passionate about Cybersecurity and have built custom Android ROMs in the past. I am looking for a full-time position as a Linux Engineer/Administrator/devops or a similar role that leverages my skills and interests.