xserver-SIXEL VS libsixel

If you really want crazy, run `xterm -ti 340`, then run run an X server from the xserver-sixel repository <https://github.com/saitoha/xserver-SIXEL> in it. Now y ou can run as many terminal emulators, complete with real truetype fonts and all the colors you could want, inside the one terminal. Use a tiling window manager and you’ll be able to avoid using tmux entirely.

There's a X with sixel support: https://github.com/saitoha/xserver-sixel

I played with this before, and I could use X11 within a mlterm terminal.

I should try to recompile it with cosmopolitan to have a single X server binary both for Windows and Linux

What you do is run `xterm -ti vt340`. If your xterm was compiled with SIXEL support, this will enable it. (You can test it by running something simple like `gnuplot -e "set terminal sixelgd; set key bmargin center horizontal; plot [-5pi:5pi] [-5:5] real(tan(x)/atan(x)), 1/x"`.)

Now run Xsixel (from <https://github.com/saitoha/xserver-sixel>) to run an X server that outputs to sixel graphics. In that X server you can run any program you would like, and its graphical output will be converted to sixels, printed to stdout, given to xterm, and then xterm will draw them.

Job done!

See <https://saitoha.github.io/libsixel/> for more information and tools, along with lots of screenshots.

There's a version of X for these terminals: https://github.com/saitoha/xserver-sixel

You could probably do something like run X on Sixel for terminals that support Sixel.

> unfortunately it's way too slow to get anywhere near 'realtime' output (30fps or better).

That's not due to sixels. Check out the sixel nyan cat: https://github.com/hackerb9/sixvid

Look at the FPS indicator in the bottom. It was pointed to me in https://github.com/microsoft/Terminal/issues/448#issuecommen...

The issue may be in your code.

I think I have similar performance issues, as the glyph selection process could be more optimized.

Derasterized is mostly Jart work (who is best known here for her work on Cosmopolitan), we were mostly interested in quality.

Reducing the set of glyph to something that could benefit from optimizations could help.

> I really wish there was a decent pixel-framebuffer standard for terminals (with at least the same performance as ncurses)

Sixel performance is quite decent: personally, I can play videos in my terminal.

Try MPV on mintty: https://github.com/mpv-player/mpv/issues/2183

I have also played with a X server rendering over sixel, no performance issue: https://github.com/saitoha/xserver-SIXEL

When sixel support is added to Windows Terminal, I may update it, because it would be fun to have one tab to run stuff!

Library you can use to generate these images:

https://github.com/saitoha/libsixel

Plenty of links to other projects.

Sixels are pixels and enjoy a wide support due to how old it is.

Kitty protocol is PNG or primitives - which BTW would make it great for a GUI library.

Different tools for different needs, but if you are going for a wide support you want something simple that doesn't have 5 different types you have to separately implement and test:

> d: Direct (the data is transmitted within the escape code itself)

> f: A simple file (regular files only, not named pipes or similar)

> t: A temporary file, the terminal emulator will delete the file after reading the pixel data. For security reasons the terminal emulator should only delete the file if it is in a known temporary directory, such as /tmp, /dev/shm, TMPDIR env var if present and any platform specific temporary directories and the file has the string tty-graphics-protocol in its full file path.

> s: A shared memory object, which on POSIX systems is a POSIX shared memory object and on Windows is a Named shared memory object. The terminal emulator must read the data from the memory object and then unlink and close it on POSIX and just close it on Windows.

> What nonsense, it takes literally 15 lines of code without using anything beyond the standard library to write a client

Conveniently taking a preencoded PNG and assuming away the necessary queries of supported protocol:

> Since a client has no a-priori knowledge of whether it shares a filesystem/shared memory with the terminal emulator, it can send an id with the control data, using the i key (which can be an arbitrary positive integer up to 4294967295, it must not be zero).

> for the kitty graphics protocol. I challenge you to match that for sixel

https://github.com/saitoha/libsixel/tree/master/perl

    use Image::LibSIXEL;

Also:

https://github.com/saitoha/libsixel

contains img2sixel, which lets you dump images to the terminal. It can also do animated GIFs.

Video:

https://github.com/saitoha/FFmpeg-SIXEL

GUI apps:

https://github.com/saitoha/SDL1.2-SIXEL

and more, linked from the libsixel repository.

Not sure of Terminal emulator capabilities on Apple devices, but thanks to https://github.com/saitoha/libsixel , several applications, including emacs very much support image output in terminals.

You don't have multi-colored terminal output? Even legacy systems have long had Sixel support.

> SIXEL is one of image formats for printer and terminal imaging introduced by Digital Equipment Corp. (DEC). Its data scheme is represented as a terminal-friendly escape sequence. So if you want to view a SIXEL image file, all you have to do is "cat" it to your terminal

https://github.com/saitoha/libsixel