llm.f90
Fortran-code-on-GitHub
llm.f90 | Fortran-code-on-GitHub | |
---|---|---|
13 | 9 | |
48 | 261 | |
- | - | |
8.4 | 9.8 | |
about 2 months ago | 5 days ago | |
Fortran | ||
MIT License | The Unlicense |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm.f90
- llm.f90: LLM Inference in Fortran
-
karpathy/llm.c
I'd like to think he took the name from my llm.f90 project https://github.com/rbitr/llm.f90
It was originally based off of Karpathy's llama2.c but I renamed it when I added support for other architectures.
Probable a coincidence :)
-
Winteracter – The Fortran GUI Toolset
I'm a Fortran hobbyist. I'm working (unfortunately less frequently now) on a LLM framework in Fortan: https://github.com/rbitr/llm.f90
- Fortran implementation of phi-2 LLM
- Fortran implementation of phi-2 language model
-
TinyLlama: An Open-Source Small Language Model
Also, I should promote the code I wrote for running this. It runs models in ggml format, the one I made available is an older checkpoint though. It's easy to convert the newer one. And it's in Fortran but it should be easy to get gfortran if you don't have it installed.
https://github.com/rbitr/llm.f90/tree/optimize16/purefortran
- Mamba LLM Inference on CPU
-
Minimal implementation of Mamba, the new LLM architecture, in 1 file of PyTorch
The original mamba code has a lot of speed optimizations and other stuff that make it difficult to immediately get so this will help with learning.
I can't help but also plug my own Mamba inference implementation. https://github.com/rbitr/llm.f90/tree/master/ssm
- Mamba state-space LLM inference
-
Guide to the Mamba architecture that claims to be a replacement for Transformers
You may also be interested in https://github.com/rbitr/llm.f90/tree/master/ssm it's my inference only implementation of mamba which ends up being much simpler than the training code in the original repo
Fortran-code-on-GitHub
- Fortran 2023 has been published
-
Any help or tips for Neural Networks on Computer Clusters
The hints in place ("there is more infrastructure already available outside Fortran, consider using them instead"). Beliavsky's compilation Fortran code on GitHub with its section about neural networks and machine learning still may be worth a visit e.g. how let Fortran reach out for the implementations in other languages.
-
Is Fortran good to program IA ?
There is an interesting directories compiled about projects around Fortran, Fortran code on GitHub. Though artificial intelligence does not appear by name, section Neural networks and Machine Learning may provide an entry.
- Directory of Fortran codes on GitHub, arranged by topic
-
how do you deal with not having common useful functions and data-structures that languages like c++ have?
My list of Fortran codes on GitHub has a section Containers and Generic Programming with some of the data structures you mention.
-
Why Fortran is easy to learn
There's modern stuff being written in astro(nomy/physics) (I can attest to some of the codebases listed in https://github.com/Beliavsky/Fortran-code-on-GitHub#astrophy... being modern, at least in terms of development), but I'd say C++ likely does have the upper hand for newer codebases (unless things have changed dramatically last time I looked, algorithms that don't nicely align with nd-arrays are still painful in Fortran).
I've also heard rumours of Julia and even Rust being used (the latter because of the ability to reuse libraries in the browser e.g. for visualisation), but the writers of these codebases (and the Fortran/C/C++/Java) are unusual—Python and R (and for some holdouts, IDL) are what are most people write in (even if those languages call something else).
-
Ask HN: What tools do people use for Computational Economics?
"QuantEcon:Open source code for economic modeling" https://quantecon.org/ has Python and Julia versions. The Federal Reserve uses Julia in its macroeconomic models: https://frbny-dsge.github.io/DSGE.jl/latest/ . Some economists use Fortran (which is much modernized since FORTRAN 77), and there is a 2018 book Introduction to Computational Economics using Fortran https://www.ce-fortran.com/ . Some Fortran codes in economics, statistics, and time series analysis are listed at https://github.com/Beliavsky/Fortran-code-on-GitHub .
-
Climate Change Open Source Projects on GitHub
At the "Fortran Code on GitHub" repo https://github.com/Beliavsky/Fortran-code-on-GitHub there are many codes listed in the "Climate and Weather" and "Earth Science" sections.
-
A simple string handling library for Microsoft Fortran-80
Fortran 77 and later versions (most recently Fortran 2018) have strings. There is the limitation that the elements of an array of strings must have equal length, so that ["boy","girl"] is invalid but ["boy ","girl"] is. Libraries for manipulating strings in Fortran are listed at https://github.com/Beliavsky/Fortran-code-on-GitHub#strings .
What are some alternatives?
rwkv.f90 - Port of the RWKV-LM model in Fortran (Back to the Future!)
stdlib - Fortran Standard Library
neural-fortran - A parallel framework for deep learning
cmake-cookbook - CMake Cookbook recipes.
inference-engine - A deep learning library for use in high-performance computing applications in modern Fortran
dockcross - Cross compiling toolchains in Docker images
fastGPT - Fast GPT-2 inference written in Fortran
fpm - Fortran Package Manager (fpm)
mamba-minimal - Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
llvm-project - The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
string - Microsoft FORTRAN-80 (F80) string handling library. Simple, fast, mostly FORTRAN.