picoGPT
ddgr
picoGPT | ddgr | |
---|---|---|
7 | 25 | |
3,081 | 2,860 | |
- | - | |
1.9 | 5.3 | |
about 1 year ago | 15 days ago | |
Python | Python | |
MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
picoGPT
-
Understanding Automatic Differentiation in 30 lines of Python
In that case, you might also enjoy https://jaykmody.com/blog/gpt-from-scratch/
(here's the raw code: https://github.com/jaymody/picoGPT/blob/main/gpt2.py)
-
Transformers from Scratch
I wrote a minimal implementation in NumPy here (the forward pass code is only 40 lines): https://github.com/jaymody/picoGPT
Although this is for a decoder-only transformer (aka GPT) and doesnt include the encoder part.
- FLaNK Stack Weekly 3 April 2023
-
GPT-4 Says an Open-Source Chatbot Vicuna Reaches 90% ChatGPT Quality
Take a look at https://github.com/jaymody/picoGPT/blob/a750c145ba4d09d57648...
Yes, this is GPT-2 not 4 and it‘s not the Chat, only the model and it‘s basically only the inference part, not the training loop and it‘s somewhat simplified.
Still, take a good look.
That‘s essentially what it is and a single sheet of paper.
There is nothing specifically about language in „language model“, we just call it that. Better to call it just LLM.
Nobody knows exactly what it learns, although there would be ways to poke around given some research programs. But it seems like the interest in that is limited currently, everyone is busy with improving it or with applications.
Perhaps the answer is that we overestimated what a mind is. It‘s like we used to ask what life is and it turned out that there is nothing special about life, not even the DNA is controlling anything. It‘s merely a chemical process, even though a complex process.
-
u/functor7 explains why AIs like ChatGPT do not "understand" their subject
(The hardest part was just designing a math function that has the capability of getting good at this game, but when all is said and done, it need not be a whole lot of code).
- PicoGPT: An unnecessarily tiny implementation of GPT-2 in NumPy
- picoGPT: An unnecessarily tiny implementation of GPT-2 in NumPy
ddgr
-
Add Link to selection without using the browser
Using the shell commands plugin and ddgr, I managed to create a nice trick, which allows you to add the link to selected text without having to google it (hard to describe, but the gif should give you the idea). Here is how it works: - install the shell commands plugin https://obsidian.md/plugins?id=obsidian-shellcommands - install ddgr https://github.com/jarun/ddgr - add the following code as shell command: bash query="{{selection}}" link=$(ddgr --num=1 --json "$query" | grep "url" | cut -d'"' -f4) mdlink="[$query]($link)" echo -n "$mdlink" - in the settings for that shell command, set the stdout to "current file: caret position" - you are good to go. (Maybe give it a hotkey)
-
Chatgpt is pretty nice for terminals, one of the biggest reason you leave the terminal is to look stuff up on the web, which you can now do easily from CLI
search from the CLI is hardly new.. some examples by jarun: - google: https://github.com/jarun/googler - duckduckgo: https://github.com/jarun/ddgr
- FLaNK Stack Weekly 3 April 2023
-
What video(s) really demonstrates how effective and helpful vim can be?
Leveraging filter commands (i.e. :!) to easily/quickly manipulate lines or entire buffers/files. For example, :!date will run the external date and show you results, but :.!date (which is done by typing !! then date will run the external date command and put the result on the current line. But, also, if you have the word date on a line, then you can run :.!bash (which is done by typing !! then bash), which will execute the command date and replace the current line with the result. There are infinite uses for this, like :!sort (for sorting text), :!column -t (for aligning/tabulating text), :!awk for text manipulation, :!ddgr duckduckgo cli, ...etc
- ddgr: DuckDuckGo from the terminal
- What happened to jarun/googler GitHub repo?
-
This might be a repost but I was wondering if on there was a program (linux debian based) that would allow you to make searches on youtube for videos (preferely based on mpv) kinda line ani-cli for gogoanime ? (or if there's a way to repurpose ani-cli to search on youtube)
I like ddgr https://github.com/jarun/ddgr. Duckduckgo for the terminal. googler (https://github.com/jarun/googler) was great but google seem to have crippled it, at least for me. ddgr --site youtube.com QUERY .... You can use the builtin URL handler, or the JSON output, to pass the URL to a video player like mpv. yt-dlp is required for mpv to launch the video from URL.
-
I dare you
Here is link number 1 - Previous text "Yes"
- Googler archived
What are some alternatives?
gpt4all - gpt4all: run open-source LLMs anywhere
pup - Parsing HTML at the command line
glances - Glances an Eye on your system. A top/htop alternative for GNU/Linux, BSD, Mac OS and Windows operating systems.
ytfzf - A posix script to find and watch youtube videos from the terminal. (Without API)
taskwarrior - Taskwarrior - Command line Task Management
googler - :mag: Google from the terminal
ctop - Top-like interface for container metrics
tuxi - Tuxi is a cli assistant. Get answers of your questions instantly.
Tensor-Puzzles - Solve puzzles. Improve your pytorch.
cordless - The Discord terminal client you never knew you wanted.
exiftool - ExifTool meta information reader/writer
wee-slack - A WeeChat script for Slack.com. Supports threads and reactions, synchronizes read markers, provides typing notification, etc..