Show HN: SQLFrame – I ran PySpark without Spark on a SQL database

1. sqlframe

   1 2 409 9.3 Python

   Turning PySpark Into a Universal DataFrame API

   

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. snowpark-python

   2 2 302 9.9 Python

   Snowflake Snowpark Python API

   

   This is cool and in my mind super useful for migrations.

   It seems the main benefit of using something like that in daily life is that it's more convenient to generate complex SQL statements (like pivoting a table with a lot of columns).

   However, I never really liked the PySpark dataframe api and looking at the code examples, SQL has the same visual complexity.

   Snowflake has built something similar (just for Snowflake) SnowPark [1]. Here one promoted benefit was that you could also inject native Python function and "extend" the SQL dialect. However, I don't think it really took off.

   [1] https://github.com/snowflakedb/snowpark-python

4. ibis

   3 34 5,893 9.9 Python

   the portable Python dataframe library

   

Suggest a related project