config-file-validator
Cerberus
| config-file-validator | Cerberus | |
|---|---|---|
| 4 | 3 | |
| 279 | 3,110 | |
| 16.5% | 0.3% | |
| 8.2 | 6.7 | |
| 22 days ago | 21 days ago | |
| Go | Python | |
| Apache License 2.0 | ISC License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
config-file-validator
- Open Source: Validate XML, JSON, INI, TOML, and YAML files with one CLI
-
GitHub Action to scan for config files in your repo and validate the syntax
Github Action to use the config-file-validator (https://github.com/Boeing/config-file-validator) to recursively scan the directory structure of a repo for config files and validate their syntax as part of a CI/CD pipeline.
This is useful as a quick quality gate in your CI pipeline to validate that a syntax error was not introduced in the latest commit. Currently XML, JSON, YAML, INI, and TOML are supported with CSV, HCL, and Plist coming in the next release.
Here's how to add it to your existing workflow: https://github.com/kehoecj/validate-configs-action/tree/main...
-
Validate all your config file types with a single cli tool
Project Link: https://github.com/Boeing/config-file-validator
- Show HN: Config-file-validator – CLI tool to validate all your config files
Cerberus
-
Show HN: Config-file-validator – CLI tool to validate all your config files
I was expecting this to validate the configuration files are also valid for their use cases, not just valid JSON, TOML, etc.
If you're looking for that and Python is your jam, the library cerberus[0] is very good at it.
[0]: https://github.com/pyeve/cerberus
-
Do you think we need an open-source web scraping monitoring tool?
I wrote scrapy-test as a proof of concept for validating live pages for scrapy spiders if you're looking for some reference but if you're not using scrapy I'd recommend just adding validation tests using data validation tools like cerberus which is super underrated. I cover popular data validation techniques on this short blog I wrote if you want to learn more.
-
Can you suggest something more to grow in scraping?
Other than that, have you looked into testing scrapers? Since scrapers are working with highly dynamic data writing good tests is quite a challange. For example, for parser monitoring using cerberus is a very cool tool which allows you to define loose requirements like "phone number should always be 9 numbers" etc.
What are some alternatives?
go-binder - Go binding configuration and command flag made easy✨✨
jsonschema - An implementation of the JSON Schema specification for Python
uxf - Uniform eXchange Format (uxf) is a plain text human readable optionally typed storage format that supports custom types. It may serve as a convenient alternative to csv, ini, json, sqlite, toml, xml, or yaml.
pydantic - Data validation using Python type hints
validate-configs-action - :octocat: Github Action to validate your config files using the config-file-validator
schema - Schema validation just got Pythonic
dasel - Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
voluptuous - CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data validation library.
cue - The home of the CUE language! Validate and define text-based and dynamic configuration
Schematics - Python Data Structures for Humans™.
murex - A smarter shell and scripting environment with advanced features designed for usability, safety and productivity (eg smarter DevOps tooling)
colander - A serialization/deserialization/validation library for strings, mappings and lists.