schema
doit
schema | doit | |
---|---|---|
3 | 20 | |
2,834 | 1,783 | |
- | 0.6% | |
6.8 | 0.0 | |
5 days ago | 6 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
schema
-
Python: Data validation
Validation using Schema
- tqdm (Python)
-
How can I Unit Test on a text file?
I generally use the https://github.com/keleshev/schema to validate data. You can have a script running that monitors for updated files, then sounds up a new process to actually validate the file.
doit
-
How do you deal with CI, project config, etc. falling out of sync across repos?
I like mage for Go and doit for Python.
-
What’s with DevOps engineers using `make` of all things?
Some competitors - Rake (ruby) - Bake - Earthly - SCons - doit
-
Show HN: Jeeves – A Pythonic Alternative to GNU Make
An alternative to Scons could be Doit (<https://pydoit.org/>), which if I remember correctly was built as a faster alternative to Scons. See also reasons of some users to prefer the later to other mentioned here: <https://pydoit.org/stories.html>.
- A Python powered task management and automation tool
- Makefile Tricks for Python Projects
-
Write Posix Shell
If you code in Python, your probably should use the language as much as possible and avoid calling shell commands.
E.G:
- manipulate the file system with pathlib
- do hashes with hashlib
- zip with zipfile
- set error code with sys.exit
- use os.environ for env vars
- print to stderr with print(..., file=...)
- sometimes you'll need to install lib. Like, if you want to manipulate a git repo, instead of calling the git command, use gitpython (https://gitpython.readthedocs.io/en/stable/)
But if you don't feel like installing a too many libs, or just really want to call commands because you know them well, then the "sh" lib is going to make things smoother:
https://pypi.org/project/sh/
Also, enjoy the fact Python comes with argparse to parse script arguments (or if you feel like installing stuff, use typer). It sucks to do it in bash .
If what you need is more build oriented, like something to replace "make", then I would instead recommend "doit":
https://pydoit.org/
It's the only task runner that I haven't run away from yet.
Remember to always to everything in a venv. But you can have a giant venv for all the scripts, and just she-bang the venv python executable so that it's transparent. Things don't have to be difficult.
-
Alternatives to Makefile for Python
I've been using Doit for a project which involves gathering together documents made up of multiple Markdown files and converting to multiple formats. It's really cool but has some irritations. It didn't end up being much simpler than Make for me. I'm interested in trying some of the alternatives people have posted.
- Just: A Command Runner
-
I used Python to control a custom stop-motion animation drawing machine
The code for all of this is available here, and described in detail in my article. I'm particularly fan of doit for this type of project, and highly encourage everyone to check it out!
-
Monorepo Build Tools
Instead, I use pydoit (which is basically a Python version of make). It's simple, flexible, and quite extensible. So, here's what I do with it:
What are some alternatives?
Cerberus - Lightweight, extensible data validation library for Python
Invoke - Pythonic task management & command execution.
jsonschema - An implementation of the JSON Schema specification for Python
Prefect - The easiest way to build, run, and monitor data pipelines at scale.
voluptuous - CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data validation library.
Joblib - Computing with Python functions.
Schematics - Python Data Structures for Humans™.
schedule - Python job scheduling for humans.
colander - A serialization/deserialization/validation library for strings, mappings and lists.
Task - A task runner / simpler Make alternative written in Go
valideer - Lightweight data validation and adaptation Python library.
TaskFlow - A library to complete workflows/tasks in HA manner. Mirror of code maintained at opendev.org.