Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge. Learn more →
Top 23 Python Sqlite Projects
-
-
Project mention: I wrote this iCalendar (.ics) command-line utility to turn common calendar exports into more broadly compatible CSV files. | /r/commandline | 2023-03-24
CSV utilities (still haven't pick a favorite one...): https://github.com/harelba/q https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
Project mention: Seeking Help to Preserve Rare WWII Database on Windows 98 | news.ycombinator.com | 2023-09-18
Looks like it's an Access database. Perhaps convert it to SQLite and publish with something like https://datasette.io/?
I think the problem is, thread author doesn't know how to rip an ISO of the CD or move the database out; looks like they are getting help already though.
-
[4] "Is it possible to "flatten" structured data (like JSON?)": https://github.com/saulpw/visidata/discussions/1605
-
Project mention: How to Connect a FastAPI Server to PostgreSQL and Deploy on GCP Cloud Run | dev.to | 2023-05-26
To do this, we can use the Tortoise-ORM. Begin by installing the package:
-
-
-
Mergify
Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
-
-
Ibis could also be a target. It compiles queries written in python to multiple dataframe libraries, and SQL targets.
-
Project mention: DocArray – Represent, send, and store multimodal data for ML | news.ycombinator.com | 2023-04-27
-
-
GitHub: https://github.com/dbcli/litecli
-
Project mention: Kopia: Open-Source, Fast and Secure Open-Source Backup Software | news.ycombinator.com | 2023-09-15
Not really dumb. I do use them too but with Borgbackup on the top (since they support it natively).
I found Borgmatic ( https://torsion.org/borgmatic/ ) to be the best way to run my backups. It takes care of everything from pruning to verifying the checksum etc... and it integrates with some monitoring (like cronitor).
So Borgmatic + rsync.net is the best combo
-
There are a few things you can do here.
SQLite is great at JSON - so I often dump JSON structures in a TEXT column and query them using https://www.sqlite.org/json1.html
I also have plugins for running jq() functions directly in SQL queries - https://datasette.io/plugins/datasette-jq and https://github.com/simonw/sqlite-utils-jq
I've been trying to drive the cost of turning semi-structured data into structured SQL queries down as much as possible with https://sqlite-utils.datasette.io - see this tutorial for more: https://datasette.io/tutorials/clean-data
This is also an area that I'm starting to explore with LLMs. I love the idea that you could take a bunch of messy data, tell Datasette Cloud "I want this imported into a table with this schema"... and it does that.
I have a prototype of this working now, I hope to turn it into an open source plugin (and Datasette Cloud feature) pretty soon. It's using this trick: https://til.simonwillison.net/gpt3/openai-python-functions-d...
-
prisma-client-py
Prisma Client Python is an auto-generated and fully type-safe database client designed for ease of use
Project mention: Sunday Daily Thread: What's everyone working on this week? | /r/Python | 2023-04-16almost samezies, although I'm trying prisma-client-py for team-specific reasons.
-
-
Project mention: [Guide] A Tour Through the Python Framework Galaxy: Discovering the Stars | /r/coder_corner | 2023-04-29
Try Piccolo instead of SQLAlchemy
-
-
-
django-dbbackup
Management commands to help backup and restore your project database and media files
-
-
GarminDB
Download and parse data from Garmin Connect or a Garmin watch, FitBit CSV, and MS Health CSV files into and analyze data in Sqlite serverless databases with Jupyter notebooks.
Project mention: "How Chronic Illness Patients Are ‘Hacking’ Their Wearables" (HRV) | /r/QuantifiedSelf | 2023-06-09You may want to check out https://github.com/tcgoetz/GarminDB if you're using a newer (Elevate v4 or v5 sensor) Garmin device.
-
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
Python Sqlite related posts
- Seeking Help to Preserve Rare WWII Database on Windows 98
- What If OpenDocument Used SQLite?
- Why my favourite API is a zipfile on the European Central Bank's website
- Sqlelf: Explore ELF objects through the power of SQL
- GitHub – GSA/code-gov: An informative repo for all Code.gov repos
- Python tool for generating visualizations fast
- Is there a "datasette for PostgreSQL"?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Sep 2023
Index
What are some of the best open-source Sqlite projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | Peewee | 10,317 |
2 | q | 9,937 |
3 | datasette | 8,272 |
4 | visidata | 6,815 |
5 | tortoise-orm | 3,822 |
6 | sqlglot | 3,773 |
7 | databases | 3,534 |
8 | PonyORM | 3,312 |
9 | ibis | 3,110 |
10 | docarray | 2,490 |
11 | sqlite-web | 1,957 |
12 | litecli | 1,910 |
13 | borgmatic | 1,481 |
14 | sqlite-utils | 1,316 |
15 | prisma-client-py | 1,315 |
16 | requests-cache | 1,160 |
17 | piccolo | 1,109 |
18 | python-diskcache | 1,055 |
19 | aiosqlite | 953 |
20 | django-dbbackup | 790 |
21 | csvs-to-sqlite | 779 |
22 | GarminDB | 658 |
23 | invest-alchemy | 622 |