static-frame
aiosql
static-frame | aiosql | |
---|---|---|
8 | 10 | |
406 | 1,245 | |
1.0% | - | |
9.9 | 8.7 | |
1 day ago | 2 months ago | |
Python | Python | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
static-frame
- Static-frame: Immutable/statically-typed DataFrames with runtime type validation
-
Type-Hinting DataFrames for Static Analysis and Runtime Validation
This is inadequate, as it ignores the types contained within the container. A DataFrame might have string column labels and three columns of integer, string, and floating-point values; these characteristics define the type. A function argument with such type hints provides developers, static analyzers, and runtime checkers with all the information needed to understand the expectations of the interface. StaticFrame 2 now permits this:
-
Memoizing DataFrame Functions: Using Hashable DataFrames and Message Digests to Optimize Repeated Calculations
StaticFrame is an alternative DataFrame library that offers efficient solutions to this problem, both for in-memory and disk-based memoization.
-
The Performance Advantage of No-Copy DataFrame Operations
A NumPy array is a Python object that stores data in a contiguous C-array buffer. The excellent performance of these arrays comes not only from this compact representation, but also from the ability of arrays to share "views" of that buffer among many arrays. NumPy makes frequent use of "no-copy" array operations, producing derived arrays without copying underling data buffers. By taking full advantage of NumPy's efficiency, the StaticFrame DataFrame library offers orders-of-magnitude better performance than Pandas for many common operations.
-
Which not so well known Python packages do you like to use on a regular basis and why?
static-frame. An immutable alternative to pandas.
-
One Fill Value Is Not Enough: Preserving Columnar Types When Reindexing DataFrames
StaticFrame is an immutable DataFrame library that offers solutions to such problems. In StaticFrame, alternative fill value representations can be used to preserve columnar types in reindexing, shifting, and many other operations that require fill_value arguments. For operations on heterogeneously typed columnar data, one fill value is simply not enough.
- static-frame: Immutable and grow-only Pandas-like DataFrames with a more explicit and consistent interface.
-
Bug Sur 11.4 stuttering issues on RX 6800
For me, one example of high cpu usage is when i visit links like this one (https://github.com/InvestmentSystems/static-frame/blob/master/static_frame/performance/core.py) on GitHub. Safari is extremely laggy when i do nothing more than just scrolling around. Do you have sth like this?
aiosql
-
Don't use your ORM entities for everything – embrace the SQL
> resort to raw SQL
I'm the opposite, I would rather write SQL than "resorting to" ORM queries, which is why my favourite libraries are aiosql[1] in Python, Hugsql[2] in Clojure and similar: write the queries as SQL in .sql files, which then get exposed as functions to your code.
[1] https://nackjicholson.github.io/aiosql/
[2] https://www.hugsql.org/
-
Project template without ORM
I prefer to use aiosql https://nackjicholson.github.io/aiosql/ to organize my SQL and have it in a SQL folder. It looks like this where colons specify variables:
-
If you could choose any Python web framework to build APIs for a startup, which one would you choose and why?
I tend to do a lot of data-heavy projects, so I tend to eschew ORM-style code and use a project called aiosql to bind raw SQL to python methods, and offload as much expensive computation to the DB as possible. If I'm prototyping an endpoint (e.g. calculating percentiles for some midsized time-series data), and just need a non-performant working placeholder, it's extremely easy to dump a SQL table to pandas and yeet something together in a few lines - then smoothly replace it with a more performant SQL query down the road. Highly contextual move, but I find it to be an awesome balancing point between flexibility, scalability, performance, productivity, etc.
-
Which not so well known Python packages do you like to use on a regular basis and why?
As one of the rare Python developers who actually like SQL, my favourite database library is aiosql
-
Database as Code. Not only migrations
Only slightly off-topic, poking around in there led me to aiosql, which takes an idea I'd had and jumps forward a good long way. :-)
-
The Data-Oriented Design Process for Game Development
I've been doing something in this vein for a big personal project, using this python library: https://nackjicholson.github.io/aiosql/.
In short, I'm using a run of the mill stack (Caddy/Gunicorn/Flask/Postgres) - but with the twist that all my core logic is defined in plaintext SQL files, which get bound into namespaced Python methods by aiosql. Routing, error handling, templating, etc. are all done in Python - but all data manipulation and processing are outsourced to the DB level. All database object definitions are laid out in a massive, idempotent "init_db" method that gets called at launch, so I can essentially point the app at a fresh instance of Postgres and rebuild from scratch. The design is primarily driven by my personal distaste for ORMs, but I've found it extremely beneficial in terms of rigid typing, integrity checks, and performance.
-
Is it bad practice for my flask API to run raw SQL queries against my DB to get/post data?
Definitely check out https://nackjicholson.github.io/aiosql/ if you want to stick with SQL
-
Django 4.0 release candidate 1 released
I took that approach on my latest Flask project and it’s gone quite swimmingly. The problem I ran into was that a lot of the ecosystem, and therefore documentation, blog posts, helper libraries, etc., are all written under the assumption that you’re using an ORM. It took a while to figure out how to work around that, but once I did, I was home clear.
I also used a helper library to automatically map namespaced .sql files onto python functions with various return types, which made the development process way more elegant: https://nackjicholson.github.io/aiosql/. Absolute game changer if you plan to go this route - can’t recommend it highly enough.
-
FastAPI framework, high perf, easy to learn, fast to code, ready for production
I've been using FastAPI for some time, and now I'm using it as a full web framework (not just for REST APIs). I like writing SQL without ORMs, so the combination of aiosql[0] + FastAPI + Jinja2 works great. Add HTMX[1] and even interactive websites become easy.
That's in fact the stack I am using to build https://drwn.io/ and I couldn't enjoy it more.
Thanks Sebastián for creating it!
[0] https://github.com/nackjicholson/aiosql
What are some alternatives?
pandas-ta - Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 150+ Indicators
databases - Async database support for Python. 🗄
pandastable - Table analysis in Tkinter using pandas DataFrames.
full-stack-fastapi-template - Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.
python-lenses - A python lens library for manipulating deeply nested immutable structures
django-async-orm - Bringing Async Capabilities to django ORM
bidict - The bidirectional mapping library for Python.
fastapi-crudrouter - A dynamic FastAPI router that automatically creates CRUD routes for your models
bambi - BAyesian Model-Building Interface (Bambi) in Python.
Pebble - Java Template Engine
rubygems - Library packaging and distribution for Ruby.
mangum - AWS Lambda support for ASGI applications