datasette-ripgrep
datasette-scraper
| datasette-ripgrep | datasette-scraper | |
|---|---|---|
| 1 | 1 | |
| 70 | 57 | |
| - | - | |
| 5.0 | 2.5 | |
| 7 months ago | about 1 year ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datasette-ripgrep
-
GitHub – GSA/code-gov: An informative repo for all Code.gov repos
https://github.com/simonw/datasette-ripgrep
Seeing as there's already a JSONLD @context (schema) for code.json, CSVW as JSONLD and/or YAMLLD would be an easy way merge Linked Data graphs of tabular data:
datasette-scraper
-
GitHub – GSA/code-gov: An informative repo for all Code.gov repos
https://github.com/cldellow/datasette-scraper/#architecture
(TIL datasette-scraper parses HTML with selectolax; and Selectolax with Modest or Lexbor is ~25x faster at HTML parsing than BeautifulSoup in the selectolax benchmark:
What are some alternatives?
kylo - Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.
datasette-dashboards - Datasette plugin providing data dashboards from metadata
code-json-generator - Automation that scrapes USEPA github and provides that metadata for code.gov
semantic-code-search - Search your codebase with natural language • CLI • No data leaves your computer
extruct - Extract embedded metadata from HTML markup
code-gov - An informative repo for all Code.gov repos
hugo-obsidian - simple GitHub action to parse Markdown Links into a .json file for Hugo