ewig VS vlfi

You might be interested in ewig and immer by Juan Pedro Bolivar Puente:

https://github.com/arximboldi/ewig

https://github.com/arximboldi/immer

See the author instantly opening a ~1GB text file with async loading, paging through, copying/pasting, and undoing/redoing in their prototype “ewig” text editor about 27 minutes into their talk here:

https://m.youtube.com/watch?v=sPhpelUfu8Q

It’s backed by a “vector of vectors” data structure called a relaxed radix balanced tree:

https://infoscience.epfl.ch/record/169879/files/RMTrees.pdf

That original paper has seen lots of attention and attempts at performance improvements, such as:

https://hypirion.com/musings/thesis

https://github.com/hyPiRion/c-rrb

Ewig is an interesting implementation using immutable data structures. https://github.com/arximboldi/ewig Very proof of concept, tries to be a little vi like. Might be worth checking out.

For another approach: I built a didactic text editor to teach "value oriented design" and immutable data-structures in C++:

https://github.com/arximboldi/ewig

It's design is covered in these talks:

- Postmodern immutable data structures: https://www.youtube.com/watch?v=sPhpelUfu8Q

- The most valuable values: https://www.youtube.com/watch?v=_oBx_NbLghY

That is essentially what VLF[1] does in Emacs. It reads in discrete chunks of the file at a time and doesn’t load the next one till you try to display it. Doesn’t require any fancy data structures, just some extra book keeping and mechanics.

[1] https://github.com/m00natic/vlfi

That is an issue both related to Emacs' internal representation of buffers and modes working in the background on the data in buffers of very large files, for which there are some workarounds like vlf-mode. See for example (info "(emacs) Long Lines") for similar issues with long lines and a solution more similar to what all those other editors you mention are doing to mitigate the issue of large files and large lines.

You can edit gigabyte-large files with no trouble vlf.el https://github.com/m00natic/vlfi – though it's a bit of a separate universe, you have to use vlf-occur instead of occur to find matches over all gigabytes of the file

;; To have it offered when opening large files:

For arbitrarily large files (think GB) in terms of size of the data stored you may use e.g. vlfi.

You can use vlf package to open large files

You know how "there's an app for that" used to be a thing? Well, there's an elisp package for that: https://github.com/m00natic/vlfi

Theres always: https://github.com/m00natic/vlfi

I’m aware of a few potential solutions including: dired-async and async-shell-command. There’s also https://github.com/m00natic/vlfi for viewing large files, but I don’t know how to address GPG pinentry and TRAMP issues very well.

I think you might enjoy this mode: vlfi. It is available in the standard Elpa package listing.