cuetils
jk
Our great sponsors
cuetils | jk | |
---|---|---|
2 | 9 | |
76 | 398 | |
- | 0.0% | |
0.0 | 0.0 | |
about 2 years ago | about 1 year ago | |
Go | Go | |
BSD 3-clause "New" or "Revised" License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cuetils
-
Cue: A new language for data validation
The link is broken.
This one?
https://github.com/hofstadter-io/cuetils
Do you also make the cuetorials? It was of great help to us a few months ago. Thank you for that.
-
ETL Pipelines with Airflow: The Good, the Bad and the Ugly
I got inspired and started this over the weekend to demonstrate what is possible.
jk
- Jsonnet – The Data Templating Language
-
The Curse of NixOS
People have tried: https://github.com/jkcfg/jk
But yeah I agree. The thing is, if all you need is robust determinism why do you need a full functional language with currying and other complex concepts?
Google had the same problem for Bazel, and their solution (Starlark) is way easier to understand.
-
Pants vs. Bazel: Why Pants may be the right choice for your team
If I were writing a build system today (and I did just write one actually to test out some ideas) I would use Typescript for the language with something like jk to provide hermeticity. Typescript has many advantages, especially over Python, but mainly:
-
The Perfect Configuration Format? Try TypeScript
Great little writeup ! After mangling YAML, HCL, JSON for years as an ops engineer, I have come to the same realisation. In fact, I have put this into practice in production pipelines by using: jkcfg[1] for the last couple of years. Two data points: 1. Zero developer support contract rate around YAML syntax and templating issues 2. High number of contributions in our private typescript configuration library from developers. Using typescript as an ops frontend has made operations a lot more approachable to folks.
Recently I took what learnt in the last 2 years using jkcfg/typescript and taken it to Deno in form of an opinionated port of jkcfg called: dxcfg[2]. Its early days, but I would bet on Deno/typescript for future ops configuration.
It's possible to sandbox most languages, and with some work you can probably make them deterministic too.
Here's an example: https://github.com/jkcfg/jk
That beats having to learn an entirely new language.
Why? The only reasons I can think of are:
* They can be non-deterministic (do a different thing each time you run them).
* They can be non-hermetic (access stuff in the environment you don't know about).
* They can do naughty security things.
* You can't present GUIs of them because they aren't declarative.
All but the last one don't exclude programming languages. Here's an interesting project to make hermetic deterministic Javascript (Typescript support is planned):
For the sorts of places where you don't have a GUI for the settings anyway (which is the common case) I think it makes loads of sense. It beats making the kind of declarative programming languages you see in YAML files.
-
Cue: A new language for data validation
Maybe Javascript? A lot of web tools support Javascript config files. There's this nice-looking effort to provide a hermetic execution environment for them: https://github.com/jkcfg/jk and if you use Typescript you get an extremely good static type system too. Plus the language is already very well known with loads of tool support and documentation.
Definitely what I would use today.
-
Boa release v0.13
You may be interested in jk. If you don't want to use a special purpose configuration language (jsonnet, cue, dhall, etc), this is a nice alternative that uses js in a hermetic runtime (but see their open issues for progress on that). They seem to also be adding native typescript support so you could even have type checking built-in.
What are some alternatives?
vm2 - Advanced vm/sandbox for Node.js
dhall-lang - Maintainable configuration files
hof - Framework that joins data models, schemas, code generation, and a task engine. Language and technology agnostic.
pants - The Pants Build System
dbt-expectations - Port(ish) of Great Expectations to dbt test macros
FlatBuffers - FlatBuffers: Memory Efficient Serialization Library
jsonnet - Jsonnet - The data templating language
starlark-go - Starlark in Go: the Starlark configuration language, implemented in Go
NVTabular - NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
cue - CUE has moved to https://github.com/cue-lang/cue
dxcfg - Configuration as code for the masses
nvd