Python Sqlite

Open-source Python projects categorized as Sqlite
Edit details
Topics: #Python #Database #MySQL #SQL #Postgresql
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com
Sponsored

Top 23 Python Sqlite Projects

  • Peewee

    a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb

  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

    Project mention: I wrote this iCalendar (.ics) command-line utility to turn common calendar exports into more broadly compatible CSV files. | /r/commandline | 2023-03-24

    CSV utilities (still haven't pick a favorite one...): https://github.com/harelba/q https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • datasette

    An open source multi-tool for exploring and publishing data

    Project mention: Seeking Help to Preserve Rare WWII Database on Windows 98 | news.ycombinator.com | 2023-09-18

    Looks like it's an Access database. Perhaps convert it to SQLite and publish with something like https://datasette.io/?

    I think the problem is, thread author doesn't know how to rip an ISO of the CD or move the database out; looks like they are getting help already though.

  • visidata

    A terminal spreadsheet multitool for discovering and arranging data

    Project mention: Fx – Terminal JSON Viewer | news.ycombinator.com | 2023-09-19

    [4] "Is it possible to "flatten" structured data (like JSON?)": https://github.com/saulpw/visidata/discussions/1605

  • tortoise-orm

    Familiar asyncio ORM for python, built with relations in mind

    Project mention: How to Connect a FastAPI Server to PostgreSQL and Deploy on GCP Cloud Run | dev.to | 2023-05-26

    To do this, we can use the Tortoise-ORM. Begin by installing the package:

  • sqlglot

    Python SQL Parser and Transpiler

    Project mention: Need help in converting Presto SQLs to Hive SQL | /r/SQL | 2023-05-08

  • databases

    Async database support for Python. 🗄

    Project mention: Whats the standard way for interacting with a DB. | /r/FastAPI | 2023-03-15

  • Mergify

    Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.

  • PonyORM

    Pony Object Relational Mapper

  • ibis

    The flexibility of Python with the scale and performance of modern SQL.

    Project mention: A LLM+OLAP Solution | news.ycombinator.com | 2023-09-11

    Ibis could also be a target. It compiles queries written in python to multiple dataframe libraries, and SQL targets.

    https://ibis-project.org/

  • docarray

    Represent, send, store and search multimodal data

    Project mention: DocArray – Represent, send, and store multimodal data for ML | news.ycombinator.com | 2023-04-27

  • sqlite-web

    Web-based SQLite database browser written in Python

    Project mention: WAL Mode in LiteFS | news.ycombinator.com | 2023-01-04

  • litecli

    CLI for SQLite Databases with auto-completion and syntax highlighting

    Project mention: SQLite Functions for Working with JSON | news.ycombinator.com | 2023-08-10

    GitHub: https://github.com/dbcli/litecli

  • borgmatic

    Simple, configuration-driven backup software for servers and workstations

    Project mention: Kopia: Open-Source, Fast and Secure Open-Source Backup Software | news.ycombinator.com | 2023-09-15

    Not really dumb. I do use them too but with Borgbackup on the top (since they support it natively).

    I found Borgmatic ( https://torsion.org/borgmatic/ ) to be the best way to run my backups. It takes care of everything from pruning to verifying the checksum etc... and it integrates with some monitoring (like cronitor).

    So Borgmatic + rsync.net is the best combo

  • sqlite-utils

    Python CLI utility and library for manipulating SQLite databases

    Project mention: Welcome to Datasette Cloud | news.ycombinator.com | 2023-08-20

    There are a few things you can do here.

    SQLite is great at JSON - so I often dump JSON structures in a TEXT column and query them using https://www.sqlite.org/json1.html

    I also have plugins for running jq() functions directly in SQL queries - https://datasette.io/plugins/datasette-jq and https://github.com/simonw/sqlite-utils-jq

    I've been trying to drive the cost of turning semi-structured data into structured SQL queries down as much as possible with https://sqlite-utils.datasette.io - see this tutorial for more: https://datasette.io/tutorials/clean-data

    This is also an area that I'm starting to explore with LLMs. I love the idea that you could take a bunch of messy data, tell Datasette Cloud "I want this imported into a table with this schema"... and it does that.

    I have a prototype of this working now, I hope to turn it into an open source plugin (and Datasette Cloud feature) pretty soon. It's using this trick: https://til.simonwillison.net/gpt3/openai-python-functions-d...

  • prisma-client-py

    Prisma Client Python is an auto-generated and fully type-safe database client designed for ease of use

    Project mention: Sunday Daily Thread: What's everyone working on this week? | /r/Python | 2023-04-16

    almost samezies, although I'm trying prisma-client-py for team-specific reasons.

  • requests-cache

    Transparent persistent cache for python requests

  • piccolo

    A fast, user friendly ORM and query builder which supports asyncio. (by piccolo-orm)

    Project mention: [Guide] A Tour Through the Python Framework Galaxy: Discovering the Stars | /r/coder_corner | 2023-04-29

    Try Piccolo instead of SQLAlchemy

  • python-diskcache

    Persistent dict, backed by sqlite3 and pickle, multithread-safe.

  • aiosqlite

    asyncio bridge to the standard sqlite3 module

    Project mention: Roast my repository! | /r/learnpython | 2023-06-12

  • django-dbbackup

    Management commands to help backup and restore your project database and media files

  • csvs-to-sqlite

    Convert CSV files into a SQLite database

  • GarminDB

    Download and parse data from Garmin Connect or a Garmin watch, FitBit CSV, and MS Health CSV files into and analyze data in Sqlite serverless databases with Jupyter notebooks.

    Project mention: "How Chronic Illness Patients Are ‘Hacking’ Their Wearables" (HRV) | /r/QuantifiedSelf | 2023-06-09

    You may want to check out https://github.com/tcgoetz/GarminDB if you're using a newer (Elevate v4 or v5 sensor) Garmin device.

  • invest-alchemy

    Invest Alchemy is a trading assistant focused on ETF portfolios.

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-19.

Python Sqlite related posts

Index

What are some of the best open-source Sqlite projects in Python? This list will help you:

Project Stars
1 Peewee 10,317
2 q 9,937
3 datasette 8,272
4 visidata 6,815
5 tortoise-orm 3,822
6 sqlglot 3,773
7 databases 3,534
8 PonyORM 3,312
9 ibis 3,110
10 docarray 2,490
11 sqlite-web 1,957
12 litecli 1,910
13 borgmatic 1,481
14 sqlite-utils 1,316
15 prisma-client-py 1,315
16 requests-cache 1,160
17 piccolo 1,109
18 python-diskcache 1,055
19 aiosqlite 953
20 django-dbbackup 790
21 csvs-to-sqlite 779
22 GarminDB 658
23 invest-alchemy 622

Sponsored
Write Clean Python Code. Always.
Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com