jsonian VS vlfi

Regarding JSON, things are starting to improve: https://github.com/iwahbe/jsonian/ is pretty good, better than both javascript-mode and json-mode, even without the speed improvements.

I wrote a new major mode called jsonian-mode for editing JSON documents. json-mode has served me well for many years, but it doesn't hold up well on large documents. I wrote a new major mode jsonian-mode which parses only as necessary and minimizes the regex usage for syntax highlighting. This means that navigating very large files is faster. The json-snatcher (jsonian-path) function does not blow its stack on large files. It also includes a pretty nice utility for editing multi-line JSON strings (jsonian-edit-string).

That is essentially what VLF[1] does in Emacs. It reads in discrete chunks of the file at a time and doesn’t load the next one till you try to display it. Doesn’t require any fancy data structures, just some extra book keeping and mechanics.

[1] https://github.com/m00natic/vlfi

That is an issue both related to Emacs' internal representation of buffers and modes working in the background on the data in buffers of very large files, for which there are some workarounds like vlf-mode. See for example (info "(emacs) Long Lines") for similar issues with long lines and a solution more similar to what all those other editors you mention are doing to mitigate the issue of large files and large lines.

You can edit gigabyte-large files with no trouble vlf.el https://github.com/m00natic/vlfi – though it's a bit of a separate universe, you have to use vlf-occur instead of occur to find matches over all gigabytes of the file

;; To have it offered when opening large files:

For arbitrarily large files (think GB) in terms of size of the data stored you may use e.g. vlfi.

You can use vlf package to open large files

You know how "there's an app for that" used to be a thing? Well, there's an elisp package for that: https://github.com/m00natic/vlfi

Theres always: https://github.com/m00natic/vlfi

I’m aware of a few potential solutions including: dired-async and async-shell-command. There’s also https://github.com/m00natic/vlfi for viewing large files, but I don’t know how to address GPG pinentry and TRAMP issues very well.

I think you might enjoy this mode: vlfi. It is available in the standard Elpa package listing.