spyql
autojump
spyql | autojump | |
---|---|---|
23 | 46 | |
902 | 15,948 | |
- | - | |
0.0 | 0.0 | |
over 1 year ago | 7 months ago | |
Jupyter Notebook | Python | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spyql
-
Fq: Jq for Binary Formats
I prefer a SQL-like format. It’s not as complete but it cover most of the day-to-day use cases. Take a look at https://github.com/dcmoura/spyql (I am the author). Congrats on fq!
-
Command-line data analytics made easy with SPyQL
SPyQL documentation: spyql.readthedocs.io
-
This Week In Python
spyql – Query data on the command line with SQL-like SELECTs powered by Python expressions
- Command-line data analytics made easy
-
Jc – JSONifies the output of many CLI tools
This is great!
I am the author of SPyQL [1]. Combining JC with SPyQL you can easily query the json output and run python commands on top of it from the command-line :-) You can do aggregations and so forth in a much simpler and intuitive way than with jq.
I just wrote a blogpost [2] that illustrates it. It is more focused on CSV, but the commands would be the same if you were working with JSON.
[1] https://github.com/dcmoura/spyql
- The fastest command-line tools for querying large JSON datasets
-
Working with more than 10gb csv
You can import the data into a PostgreSQL/MySQL/SQLite/... database and then query the database. However, even with the right choice of indexes, it might take a while to run queries on a table with hundreds of millions of records. You can easily import your data to these databases with SpyQL: $ spyql "SELECT * FROM csv TO sql(table=my_table_name) | sqlite3 my.db" (you would need to create the table my_table_name before running the command).
-
ClickHouse Cloud is now in Public Beta
https://github.com/dcmoura/spyql/blob/master/notebooks/json_...
And ClickHouse looks like a normal relational database - there is no need for multiple components for different tiers (like in Druid), no need for manual partitioning into "daily", "hourly" tables (like you do in Spark and Bigquery), no need for lambda architecture... It's refreshing how something can be both simple and fast.
- A SQLite extension for reading large files line-by-line
-
I want to convert a large JSON file into Tabular Format.
I thought this library was pretty nifty for json. It's also relatively fast compared to most json parsers: https://github.com/dcmoura/spyql
autojump
- Autojump: A CD command that learns
-
Zshell
I also use zsh for years and did not know that. What I like this: Actually having completions shown in the screen and being able to navigate them with tabs. I think that is not a default behavior, but that is what oh-my-zsh does for you in its default setup. Does someone have more insight on that?
I did not know about this, but I use https://github.com/wting/autojump, so I am not super sad that I missed something that hold me back severely. But good to know.
-
Z – Jump Around
Yes, I made a similar keybinding for xonsh, using fd and fzf. I press Alt-c, and fzf shows me all the subdirectories rooted where I'm at.
That's a good intermediary solution. But the one that totally changed my flow was to combine autojump[1] and fzf. autojump is similar to Z (this submission). It stores all the directories you've visited in an SQLite DB and can show them to you (ordered by visit frequency) with a command line argument. So I pipe that to fzf.
Now I can extremely quickly jump to any directory I've been to before - it really helps that they're sorted by visit frequency. I honestly use this more than any other approach - and I probably go for days on end without using the usual TAB autocompletion.
[1] https://github.com/wting/autojump
-
Some Useful Bash Aliases – Chuck Carroll
Not quite the same but you should check out autojump if you haven’t before: https://github.com/wting/autojump
- Cdpath: Easily Navigate Directories in the Terminal
-
People who use the terminal all the time. What are you up to?
I switched to linux recently and iam loving it the speed and CLI tools that linux provides are amazing you can do anything imaginable in the terminal i use Spotify in the terminal navigate very very fast using auto-jump and its just easier than navigating all those uis and using the keyboard for everything is way faster and easier on your hand than the mouse and keyboard combination especially if you use a window manager
-
stupid Linux tricks - cd one shell to the current dir of another, without using the clipboard, mouse, or even the pwd command
If you're interested in these types of things take a look at https://github.com/agkozak/zsh-z or https://github.com/wting/autojump
-
Have you made a bash script that improved your life in some way? My examples
Have you tried autojump?
-
What terminal apps are you using?
Dont forget to try Autojump (https://github.com/wting/autojump). Makes CDing to folders such a breeze
-
Isn’t cd .. the only acceptable way?
I would think so but here is a link for anyone that can't find it: https://github.com/wting/autojump
What are some alternatives?
prql - PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
zoxide - A smarter cd command. Supports all major shells.
malloy - Malloy is an experimental language for describing data relationships and transformations.
zsh-z - Jump quickly to directories that you have visited "frecently." A native Zsh port of z.sh with added features.
tresql - Shorthand SQL/JDBC wrapper language, providing nested results as JSON and more
z - z - jump around
Preql - An interpreted relational query language that compiles to SQL.
fasd - Command-line productivity booster, offers quick access to files and directories, inspired by autojump, z and v.
prosto - Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
fzf - :cherry_blossom: A command-line fuzzy finder
pxi - 🧚 pxi (pixie) is a small, fast, and magical command-line data processor similar to jq, mlr, and awk.
z - Pure-fish z directory jumping