logica
dbt
logica | dbt | |
---|---|---|
19 | 1 | |
1,682 | 3,802 | |
- | - | |
9.1 | 10.0 | |
21 days ago | over 2 years ago | |
Jupyter Notebook | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
logica
-
Prolog language for PostgreSQL proof of concept
If you're interested in this I would also recommend you check out Logica[0], which is a datalog-like language that is explicitly made to compile to SQL queries.
0: https://logica.dev/
- Logica
- New welcome page for Logica language
-
Introduction to Datalog
> I guess the intention is to be better than SQL but then I was left with "under which circumstances?"
Excellent question.
Two of the most common use cases for databases are "transactional processing" (manipulating small numbers of rows in real time) and "analytical processing" (querying enormous numbers of rows, typically in a read-only fashion).
SQL is generally fine for transactional workloads.
But analytical queries sometimes involve multi-page queries, with lots of JOINs and CTEs. And these queries are often automatically generated.
And once you start writing actual multi-page "programs" in SQL, you may decide that it's a fairly clunky and miserable programming language. What Datalog typically buys you is a way to cleanly decompose large queries into "subroutines." And it offers a simpler syntax for many kinds of complex JOINs.
Unfortunately, there isn't really a standard dialect of Datalog, or even a particular dialect with mainstream traction. So choosing Datalog is a bit of a tradeoff: does it buy you enough, for your use case, that it's worth being a bit outside the mainstream? Maybe! But I'd love to see something like Logica gain more traction: https://logica.dev/
-
Mangle, a programming language for deductive database programming
Interesting; a Google engineer previously published a Datalog variant for BigQuery: https://logica.dev/
This new language seems similar to differential-Datalog (which is sadly in maintenance mode): https://news.ycombinator.com/item?id=33521561
- Show HN: PRQL 0.2 – Releasing a better SQL
-
Show HN: PRQL – A Proposal for a Better SQL
Looks pretty cool. I'd be interested if the README had a comparison with Google's Logica (https://github.com/EvgSkv/logica)
-
PathQuery, Google's Graph Query Language
Oh wow that is neat!
And yes, this kind of thing is why datalog is a lot more amenable to fast query plans & runtimes than prolog. This part is especially cool: https://github.com/EvgSkv/logica/blob/main/compiler/dialects...
-
Thought about Logica: Google new programming language that compiles to SQL ?
Google new programming Language that compiles to SQL (Support BigQuery and Postgres) feels very exciting. Blog: https://opensource.googleblog.com/2021/04/logica-organizing-your-data-queries.html Github: https://github.com/EvgSkv/logica
-
Google Logica Aims To Make SQL Queries More Reusable and Readable
Going to be? It already is. In fact, one thing the article misses is right there at the bottom of the project page:
dbt
-
Open Source Analytics Stack: Bringing Control, Flexibility, and Data-Privacy to Your Analytics
Due to the rise in cloud-based data warehouses, businesses can directly load all the raw data into the data warehouse without prior transformations. This process is known as ELT (Extract, Load, Transform) and gives data and analytics teams freedom to develop ad-hoc transformations based on their particular needs. ELT became popular as the cloud's processing power and scale became better suited to transforming data. DBT (website, GitHub) is a popular open-source tool recommended for ELT and allows businesses to transform data in their warehouses more effectively. It's a great pairing with with RudderStack's Cloud Extract ETL tool.
What are some alternatives?
scryer-prolog - A modern Prolog implementation written mostly in Rust.
Apache Kafka - Mirror of Apache Kafka
ungoogled-chromium-archlinux - Arch Linux packaging for ungoogled-chromium
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
malloy - Malloy is an experimental language for describing data relationships and transformations.
superset - Apache Superset is a Data Visualization and Data Exploration Platform
prql - PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Snowplow - The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
dbt-core - dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
nbdev - Create delightful software with Jupyter Notebooks
differential-datalog - DDlog is a programming language for incremental computation. It is well suited for writing programs that continuously update their output in response to input changes. A DDlog programmer does not write incremental algorithms; instead they specify the desired input-output mapping in a declarative manner.
rudderstack-docs - Documentation repository for RudderStack - the Customer Data Platform for Developers.