sqlite_protobuf
lnav
sqlite_protobuf | lnav | |
---|---|---|
2 | 77 | |
80 | 6,727 | |
- | - | |
0.0 | 9.6 | |
over 1 year ago | 3 days ago | |
C++ | C++ | |
MIT License | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlite_protobuf
-
One-liner for running queries against CSV files with SQLite
SQLite's virtual table API (https://www.sqlite.org/vtab.html) makes it possible to access other data structures through the query engine. You don't need to know much if anything about how the database engine executes queries, you only need to implement the callbacks it needs to do its job. A few years ago I wrote an extension to let me search through serialized Protobufs which were stored as blobs in a regular database.
https://github.com/rgov/sqlite_protobuf
-
SQLite Plus: all the missing SQLite functions
Some time ago I joined a project that was recording logs in Protobuf format. I demonstrated that we could log the serialized Protobuf structures to a SQLite database and then use a plugin to query across the message fields: https://github.com/rgov/sqlite_protobuf
Learning how to use the SQLite extension API was a little mind-expanding but it worked like a charm.
lnav
- Lnav: A log file viewer for the terminal
-
Angle-grinder: Slice and dice logs on the command line
See https://lnav.org for a powerful mini-ETL CLI power tool; it embeds SQLite, supports ~every format, has great UX and easily handles a few million rows at a time.
- FLaNK Stack 26 February 2024
- LNAV – The Logfile Navigator
-
Toolong: Terminal application to view, tail, merge, and search log files
The code base seems like a good reference as a small Python project.
My fav option in this class of apps: https://lnav.org/ It lets you use journalctl with pipes as requested here: https://github.com/Textualize/toolong/issues/4
-
Logdy.dev – web based logs viewer UI for local development environment
For local development, I cannot recommend lnav[1] enough. Discovering this tool was a game changer in my day to day life. Adding comments, filtering in/out, prettify and analyse distribution is hard to live without now.
I don't think a browser tool would fit in my workflow. I need to pipe the output to the tool.
[1] https://lnav.org/
- Textanalysistool.net
- Ask HN: What apps have you created for your own use?
-
Ask HN: How does `lnav` run its playground which you can just SSH into?
It looks like they run an SSH server inside a Docker container defined by this Dockerfile [1]. This uses the ForceCommand directive in the sshd_config file to ensure that a specific command is run when a user connects (rather than the user connecting directly to a shell).
Depending on whether the user connects as the `playground` or `tutorial1` user they interact with a bash script that is either [2] or [3].
[1]: https://github.com/tstack/lnav/blob/master/demo/Dockerfile
[2]: https://github.com/tstack/lnav/blob/master/docs/tutorials/pl...
[3]: https://github.com/tstack/lnav/blob/master/docs/tutorials/tu...
What are some alternatives?
dflat - Structured Data Store for Mobile
lightproxy - 💎 Cross platform Web debugging proxy
sqlite_ora_functions
dive - A tool for exploring each layer in a docker image
sqlite-plus - The ultimate set of SQLite extensions
glow - Render markdown on the CLI, with pizzazz! 💅🏻
sqlite-parquet-vtable - A SQLite vtable extension to read Parquet files
GoAccess - GoAccess is a real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.
visidata - A terminal spreadsheet multitool for discovering and arranging data
conio-for-linux - Conio.h for linux
json2csv - Convert json to csv with column titles
nnn - n³ The unorthodox terminal file manager