spl.js
mergestat-lite
Our great sponsors
spl.js | mergestat-lite | |
---|---|---|
10 | 10 | |
158 | 3,416 | |
- | 0.4% | |
4.6 | 6.5 | |
about 1 month ago | 6 days ago | |
JavaScript | Go | |
GNU General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spl.js
- SpatiaLite (SQLite extension) for browser and node
-
Exploring SQLite Implementations for the Web in 2023
Use spatialite WASM https://github.com/jvail/spl.js Can read geopackage and Shapefiles and GeoJSON and KML and GPX and perform operations
-
Manipulate CSV files in your browser using SQL
I use SPATIALITE WEBASSEMBLY let's you use CSV or excel or JSON or sqlite or gpkg or shapefiles or KML in the browser https://github.com/jvail/spl.js
-
Online tool to process GeoJSON data using JavaScript
I recommend you add spatialite webassembly so you can run spatial functions operations https://github.com/jvail/spl.js Support geopackage vector features and esri mobile geodatabase (sqlite) and shapefiles and kml and output GEOJSON for map view (ExportGeojson2)
-
geopackage sqlite
https://github.com/jvail/spl.js The geopackage pub.dev package could not work for me reading vector geometry from. Geopackage
-
Cascading slider filters and exposing SQL query builder on leaflet
Take a look at spatialite web assembly you can do full spatialite functions and operations on GeoJSON data or Shapefile or geopackage and even KNN NEAREST And point in polygon. No server needed run in the browser https://github.com/jvail/spl.js
-
If I have a GeoJSON file of a certain city's wards, how would I figure out which ward I'm in based on my lat/long coordinates?
We've recently been using more client-side (browser based approaches for this type of work) that have more horsepower and functionality than TurfJS) we've successfully used both https://github.com/jvail/spl.js Web Assembly Version
- A SQLite extension for reading large files line-by-line
- SpatiaLite: Extends SQLite core to support Spatial SQL capabilities
-
Combining several feature layers into 1 layer using ArcGIS JavaScript
https://github.com/jvail/spl.js Your use case could be good for doing this in spatialite Create a new geopackage Import GeoJSON from featureserver or mapserver layers -f=GeoJSON for each layer or use virtualgeojson You can make the import happen for new records or changes And then create new table and append the records Then you can execute SQL queries Counts or Distinct or where clauses
mergestat-lite
-
SQLite Doesn't Use Git
You can query git with this: https://github.com/mergestat/mergestat if you like the idea.
-
A SQLite extension for reading large files line-by-line
Hey, author here, happy to answer any questions! Also checkout this notebook for a deeper dive into sqlite-lines, along with a slick WASM demonstration and more thoughts on the codebase itself https://observablehq.com/@asg017/introducing-sqlite-lines
I really dig SQLite, and I believe SQLite extensions will push it to another level. I rarely reach for Pandas or other "traditional" tools and query languages, and instead opt for plain ol' SQLite and other extensions. As a shameless plug, I recently started a blog series on SQLite and related tools and extensions if you want to learn more! Next week I'll be publishing more SQLite extensions for parsing HTML + making HTTP requests https://observablehq.com/@asg017/a-new-sqlite-blog-series
A few other SQLite extensions:
- xlite, for reading Excel files, in Rust https://github.com/x2bool/xlite
- sqlean, several small SQLite extensions in C https://github.com/nalgeon/sqlean
- mergestat, several SQLite extensions for developers (mainly Github's API) in Go https://github.com/mergestat/mergestat
- Show HN: Contribution Graph as a Git Command
-
Exploring Git Repos With MergeStat 🔬
mergestat is an open-source tool that allows users to run SQL queries on the contents and history of git repositories.
-
The world of PostgreSQL wire compatibility
Thanks for this write up! I've been really interested in postgres compatibility in the context of a tool I maintain (https://github.com/mergestat/mergestat) that uses SQLite. I've been looking for a way to expose the SQLite capabilities over a more commonly used wire-protocol like postgres (or mysql) so that existing BI and visualization tools can access the data.
This project is an interesting one: https://github.com/dolthub/go-mysql-server that provides a MySQL interface (wire and SQL) to arbitrary "backends" implemented in go.
It's really interesting how compatibility with existing protocols has become an important feature of new databases - there's so much existing tooling that already speaks postgres (or mysql), being able to leverage that is a huge advantage IMO
-
Go library for printing human readable, relative time differences 🕰️
timediff is a Go package for printing human readable, relative time differences. Output is based on ranges defined in the Day.js JavaScript library, and can be customized if needed. It's currently used by the mergestat command-line interface.
- Askgit: Command-line tool for running SQL queries on Git repositories
-
Semantic Git Commit Messages
Assuming committers adhere to it, there could be some interesting use cases when combined with a tool like AskGit (https://github.com/askgitdev/askgit) for understanding what "categories" of work is being done in a codebase.
Maybe even what directories/files tend to see `fix` or `refactor` more frequently (signs of a poorly design or "hot" area?)
-
Git as a NoSql Database
I've been very curious to explore this type of use case with askgit (https://github.com/augmentable-dev/askgit) which was designed for running simple "slice and dice" queries and aggregations on git history (and change stats) for basic analytical purposes. I've been curious about how this could be applied to a small text+git based "db". Say, for a regular json or CSV dumps.
This also reminds me of Dolt: https://github.com/dolthub/dolt which I believe has been on HN a couple times
What are some alternatives?
rtree.c - An R-tree implementation in C
git-xargs - git-xargs is a command-line tool (CLI) for making updates across multiple Github repositories with a single command.
datasette-lite - Datasette running in your browser using WebAssembly and Pyodide
crux - General purpose bitemporal database for SQL, Datalog & graph queries. Backed by @juxt [Moved to: https://github.com/xtdb/xtdb]
sqlite-lines - A SQLite extension for reading large files line-by-line (NDJSON, logs, txt, etc.)
flan - A tasty tool that lets you save, load and share postgres snapshots with ease
geojsonscript - GeoJSON scripting environment in the web browser
sqlite-plus - The ultimate set of SQLite extensions
csv-sql - Command-line tool to load csv and excel (xlsx) files and run sql commands
xlite - Query Excel spredsheets (.xlsx, .xls, .ods) using SQLite
gitalias - Git alias commands for faster easier version control