DistorteD VS IntelliJ-Luanalysis

> If you have any resources on this topic off the top of your head I'd appreciate it if you shared them

I wrote a Ruby library that attempts to be good at this https://github.com/okeeblow/DistorteD/tree/NEW%E2%80%85SENSA...

Just a style thing. I find it less visually overwhelming when every statement that contributes a true/false is visually contiguous. You can see it in context here if curious: https://github.com/okeeblow/DistorteD/blob/NEW%E2%80%85SENSA...

I experienced a heisenbug exactly like this in Ruby when trying to `while case Ractor::receive`: https://github.com/okeeblow/DistorteD/blob/dd2a99285072982d3...

Here's one that sounds like exactly the sort of example you had in mind: https://github.com/okeeblow/DistorteD/tree/NEW%E2%80%85SENSA...

Disclaimer: mine :)

This resulted in a huge memory-usage win since I can load data on the fly without blocking other queries. The last pre-Ractorized version of CYO allocated around ~200k objects in 7MiB and retained ~17k in 2MiB of memory. The first Ractorized version allocated ~20k objects in 2MiB and retained ~2.5k objects in ~260KiB of memory. See revision 8c88844b9d256ecc447f6818ab427284b5636cb9 for the initial conversion.

This is the use-case for me. Here's an actual example of a Struct I will probably convert to Data in the file-identification library I've been working on. Right now they just have their `#to_a` overridden to disable some of their annoying automatic Enumerable behavior: https://github.com/okeeblow/DistorteD/blob/dd2a99285072982d3...

In addition to this resource and UK's equivalent (PRONOM/DROID, also mentioned in the linked post), I've found ArchiveTeam's wiki to be very useful for obscure file format details: http://fileformats.archiveteam.org/

The `shared-mime-info` database from freedesktop-dot-org is probably more worthy of contribution than these government-backed databases, at least in terms of number-of-end-users. New type definitions in their database will improve the entire Linux/BSD ecosystem (both desktop and server!) because it's consumed not only by fd.o's own `update-mime-database` utility but by many language-specific type-identification libraries too https://gitlab.freedesktop.org/xdg/shared-mime-info/-/blob/m...

…including (shameless plug) the new Ractor-based Ruby type library I've been working on in the wake of the `mimemagic` drama earlier this year: https://github.com/okeeblow/DistorteD/tree/NEW%E2%80%85SENSA...

> for example it’s asynchronous

Ruby also lets you build programs like this as of 3.0, using Ractor#send / Ractor::receive https://docs.ruby-lang.org/en/master/doc/ractor_md.html#labe...

It’s still pretty new so a lot of the Gem ecosystem hasn’t caught up yet (e.g. C extensions need to be explicitly opted-in as Ractor-safe), but I built a new “MIME::Types” library replacement with it recently and have enjoyed very few teething issues: https://github.com/okeeblow/DistorteD/blob/NEW%E2%80%85SENSA...

I considered switching to Hugo a while back but ended up sticking with Jekyll for the extensibility, like a few others have said. I'm particularly interested in image thumbnailing and format conversion since so many of my posts are image-heavy. I often found that to be my biggest and most frequent barrier to writing since plain text only goes so far on the modern web.

In Hugo, every solution I've seen uses a custom shortcode or custom Markdown image template-rendering hook along with Hugo's build-in image resizing. Many posts even suggest converting image resources to different formats with an external tool. It does seem like the image handling situation in Hugo is improving since it just gained WebP processing support in addition to JPEG: https://gohugo.io/news/0.83.0-relnotes/

Jekyll plugins offer way more power than a shortcode ('include' in Jekyll-speak) can, like how the author of the OP is using Jekyll-Picture-Tag. I've been working on my own similar plugin to handle converting and embedding my site's images, videos, SVGs, PDFs, text files, fonts and weird retro computer formats, etc. For example I can embed an SVG using standard Markdown syntax like `` and get a tag with the SVG plus rasterized JPG+WebP+AVIF+whatever at multiple sizes all totally seamlessly: https://github.com/okeeblow/DistorteD

Very happy the existence of Hugo lit a fire under the Jekyll team to work on speed though :)

> It works at first, but you end up wanting to design your own custom SSG once you run up against something that goes against your mental model of how things should work.

There is a middle ground. I hit this point in Jekyll when I wanted Insanely Great image thumbnailing that no extant Jekyll plugin could provide, ended up writing my own tool to do that, but didn't want to duplicate the rest of Jekyll's functionality too. It's kiiinda hacky and I probably should propose the interface changes upstream if I keep doing this, but a very light monkey-patch lets my tool pretend to be a Jekyll::StaticFile that just happens to write out many separate files: https://github.com/okeeblow/DistorteD/blob/master/DistorteD-...

Because of compile-time type safety / static analysis. And I say this as the author of an IDE that bolts those features onto Lua: https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis

I want to start adding support for Lua derivatives to my IDE (which adds static type checking to Lua - inference, structural & nominal types, generics etc. (Luanalysis - https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis/)

I feel like plugin support would be best but I've no idea how that's supposed to work in the presence of a predefined grammar. There's also so many variants I don't think there's a good way to build composite grammar.

Does anyone have any ideas about how to extend language parsing? For reference, I'm using https://github.com/JetBrains/Grammar-Kit.

There's also my IDE which just bolts on types (both structural and nominal) to regular Lua - no transpiling as the types are defined with comments (or inferred).

https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis/

Unfortunately, I haven't been able to give it as much attention as it deserves recently.

What do you mean by no lambdas exactly? Lua supports anonymous functions and those functions capture variables from their outer scope.

I use functional programming extensively in Lua also. Could you elaborate on what it doesn't permit?

Integers were introduced in 5.3.

Assigning operators? It has metatables, you can absolutely implement your own operators.

If you want static typing you can use my IDE: https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis/

Granted, my IDE is incredibly opinionated and not for everyone.

Also, Lua is not my favourite language to use, doesn't even make top 3. However, the robustness of its design, considering its simplicity, is incredibly elegant.

Anyway, you can find screenshots in the project's README on Github: https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis

Location: Melbourne, Australia

Remote: Yes

Willing to relocate: Yes (Post-Covid)

Technologies: Kubernetes, AWS, TypeScript, Ruby, React. Polyglot, refer to résumé.

Résumé/CV: https://drive.google.com/file/d/1VJk9gs1-LN3e333ZDICwkG5pgTb...

Email: [email protected]

Github: https://github.com/Benjamin-Dobell/

LinkedIn: https://www.linkedin.com/in/benjamindobell/

Current Role: CTO @ Snaploader

Salary Expectation: $200,000+ USD

These days I describe myself as a full-stack developer, but I’ve also plenty of professional experience with mobile (native + React Native), infrastructure, ops, game development, tooling and reverse engineering. In my free time I also tinker with embedded systems. I’m an avid open source contributor, but also maintain many of my own open-source projects e.g. a Lua IDE which statically type checks Lua (https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis).

I’ve 12+ years of development experience, the last six years I’ve been CTO of Snaploader, a small start-up in Australia which turns floor-plans and CAD drawings into real-time rendered 3D buildings that run in your browser (including mobile). HQ is interstate, thus the role has always been near 100% remote. There’s a team of 20+ 3D artists and sales, but development is a one man show. So I’m responsible for a pretty absurd amount.

I also occasionally take on casual consulting gigs, which typically come about from my open source contributions. Currently I’m consulting for Berserk Games. I work on their Lua language bindings, public API documentation, networking and tooling for the (user content centric) game Tabletop Simulator (Unity/C#). I also help out their developer community with support, libraries, documentation and example projects i.e. developer advocacy.

Please do peruse my Github. I’m after something senior where I can take some ownership, but ideally also contribute across a breadth of projects/technologies.

Me: Okay. I'm just going to prototype a game. Don't want to get carried away. I won't even write a game engine. I'll use Tabletop Simulator.

Friend: Sounds good. How's it going?

Me: Well. I needed to be able to debug my code. https://github.com/tts-community/moonsharp-tts-debug

Friend: Oh, neat. So your game is done now?

Me: Not exactly. I had to had in matchmaking by reverse engineering Steam. https://github.com/SteamRE/SteamKit/pull/704

Friend: Ah. Alright. Can I play it now?

Me: Nah, I was finding it hard to maintain code. I wrote a Lua code bundler. https://github.com/Benjamin-Dobell/luabundle

Friend: Sweet.

Me: Yeah, but I decided to integrate it into the official tooling. https://github.com/Berserk-Games/atom-tabletopsimulator-lua/...

Friend: I'm sure the community will be thankful.

Me: I hope so. I now run a small community of TTS developers. https://github.com/tts-community/

Friend: Right. You must be done by now.

Me: Nah, I couldn't statically type check my code. So I wrote some types. https://github.com/Benjamin-Dobell/tts-types

Friend: Seems unnecessary for a prototype, but sure.

Me: I had to write my own IDE to use them though. https://github.com/Benjamin-Dobell/IntelliJ-Luanalysis

Friend: Right... So how'd the game going then?

Me: Oh, I'm not doing that anymore. I now consult for Berserk Games, developers of Tabletop Simulator

Friend: ...

Atom (most basic), Vscode with emmylua (debugging) and tabletop simulator lua, or Intellij with luanalysis (type safety). all are really good depending on your use case. I have never used the scripting window, even for simple scripts.