Python datasette

Open-source Python projects categorized as datasette

Top 23 Python datasette Projects

  • datasette

    An open source multi-tool for exploring and publishing data

  • Project mention: Ask HN: High quality Python scripts or small libraries to learn from | news.ycombinator.com | 2024-04-19

    Simon Willison's github would be a great place to get started imo -

    https://github.com/simonw/datasette

  • sqlite-utils

    Python CLI utility and library for manipulating SQLite databases

  • Project mention: Ask HN: High quality Python scripts or small libraries to learn from | news.ycombinator.com | 2024-04-19

    https://github.com/simonw/sqlite-utils

    So, his code might not be a good place to find best patterns (for ex, I don't think they are fully typed), but his repos are very pragmatic, and his development process is super insightful (well documented PRs for personal repos!). Best part, he blogs about every non-trivial update, so you get all the context!

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • csvs-to-sqlite

    Convert CSV files into a SQLite database

  • twitter-to-sqlite

    Save data from Twitter to a SQLite database

  • github-to-sqlite

    Save data from GitHub to a SQLite database

  • Project mention: Getting things done (in small increments) | news.ycombinator.com | 2024-01-01

    Yeah, I worry about that too. I have SO much of my stuff dependent on my GitHub account now.

    I'm slightly reassured by how useful their APIs are. I have automated exports of a lot of my GitHub issues, though I really should shore those up and make sure I'm capturing everything.

    That's one of the reasons I built https://github.com/dogsheep/github-to-sqlite

  • db-to-sqlite

    CLI tool for exporting tables or queries from any SQL database to a SQLite file

  • Project mention: Show HN: I built an open-source data copy tool called ingestr | news.ycombinator.com | 2024-02-27

    I was surprised to see SQLite listed as a source but not as a destination. Any big reasons for that or is it just something you haven't got around to implementing yet?

    I've been getting a huge amount of useful work done over the past few years sucking data from other systems into SQLite files on my own computer - I even have my own small db-to-sqlite tool for this (built on top of SQLAlchemy) - https://github.com/simonw/db-to-sqlite

  • healthkit-to-sqlite

    Convert an Apple Healthkit export zip to a SQLite database

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • dogsheep-beta

    Build a search index across content from multiple SQLite database tables and run faceted searches against it using Datasette

  • apple-notes-to-sqlite

    Export Apple Notes to SQLite

  • datasette-dashboards

    Datasette plugin providing data dashboards from metadata

  • Project mention: Observable 2.0, a static site generator for data apps | news.ycombinator.com | 2024-02-15

    Me too, and that lead to developing the « datasette-dashboards » plugin[0]. I use this for my company where all the data is gathered by connectors scheduled in CI, storing data in Git, and triggering a SQLite db build and Datasette deployment. « BI as Code » if you will

    [0] https://github.com/rclement/datasette-dashboards

  • pocket-to-sqlite

    Create a SQLite database containing data from your Pocket account

  • datasette-graphql

    Datasette plugin providing an automatic GraphQL API for your SQLite databases

  • Project mention: Tuql: Automatically create a GraphQL server from a SQLite database | news.ycombinator.com | 2023-04-25

    Impressive how little code is involved here! This is really neat.

    The biggest feature I can see that's missing is pagination - it looks like this doesn't have a way to retrieve e.g. ten results, then pass a next token to get back the next set.

    Here's how I implemented pagination in my similar datasette-graphql plugin (which also gives you a GraphQL API for an existing SQLite database): https://github.com/simonw/datasette-graphql#pagination

  • google-takeout-to-sqlite

    Save data from Google Takeout to a SQLite database

  • datasette-ripgrep

    Web interface for searching your code using ripgrep, built as a Datasette plugin

  • Project mention: GitHub – GSA/code-gov: An informative repo for all Code.gov repos | news.ycombinator.com | 2023-09-09

    https://github.com/simonw/datasette-ripgrep

    Seeing as there's already a JSONLD @context (schema) for code.json, CSVW as JSONLD and/or YAMLLD would be an easy way merge Linked Data graphs of tabular data:

  • datasette-chatgpt-plugin

    A Datasette plugin that turns a Datasette instance into a ChatGPT plugin

  • covid-19-datasette

    Deploys a Datasette instance of COVID-19 data from Johns Hopkins CSSE and the New York Times

  • laion-aesthetic-datasette

    Use Datasette to explore LAION improved_aesthetics_6plus training data used by Stable DIffusion

  • swarm-to-sqlite

    Create a SQLite database containing your checkin history from Foursquare Swarm

  • datasette-scraper

    Add website scraping abilities to Datasette

  • Project mention: GitHub – GSA/code-gov: An informative repo for all Code.gov repos | news.ycombinator.com | 2023-09-09

    https://github.com/cldellow/datasette-scraper/#architecture

    (TIL datasette-scraper parses HTML with selectolax; and Selectolax with Modest or Lexbor is ~25x faster at HTML parsing than BeautifulSoup in the selectolax benchmark:

  • hacker-news-to-sqlite

    Create a SQLite database containing data pulled from Hacker News

  • Project mention: Ask HN: Is there a Hacker News takeout to export my comments / upvotes, etc.? | news.ycombinator.com | 2023-12-10

    Partially. https://github.com/dogsheep/hacker-news-to-sqlite

  • datasette-auth-github

    Datasette plugin that authenticates users against GitHub

  • timezones-api

    A Datasette-powered API for finding the time zone for a latitude/longitude point

  • Project mention: SpatiaLite: Library extending SQLite to support Spatial SQL capabilities | news.ycombinator.com | 2024-01-28

    I wrote a tutorial on SpatiaLite here: https://datasette.io/tutorials/spatialite - "Building a location to time zone API with SpatiaLite"

    It shows how to use SpatiaLite + Datasette to build an API that can tell you what timezone a latitude/longitude point is in, using data derived from OpenStreetMap via https://github.com/evansiroky/timezone-boundary-builder

    Here's a demo: https://timezones.datasette.io/timezones/by_point?longitude=... - add ".json" to the URL for the JSON output.

  • datasette-auth-passwords

    Datasette plugin for authentication using passwords

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python datasette related posts

Index

What are some of the best open-source datasette projects in Python? This list will help you:

Project Stars
1 datasette 8,881
2 sqlite-utils 1,498
3 csvs-to-sqlite 858
4 twitter-to-sqlite 395
5 github-to-sqlite 376
6 db-to-sqlite 334
7 healthkit-to-sqlite 184
8 dogsheep-beta 178
9 apple-notes-to-sqlite 171
10 datasette-dashboards 131
11 pocket-to-sqlite 99
12 datasette-graphql 97
13 google-takeout-to-sqlite 92
14 datasette-ripgrep 70
15 datasette-chatgpt-plugin 63
16 covid-19-datasette 61
17 laion-aesthetic-datasette 57
18 swarm-to-sqlite 57
19 datasette-scraper 57
20 hacker-news-to-sqlite 43
21 datasette-auth-github 41
22 timezones-api 27
23 datasette-auth-passwords 19

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com