differential-datalog
souffle
differential-datalog | souffle | |
---|---|---|
22 | 12 | |
1,340 | 869 | |
0.5% | 2.4% | |
0.0 | 7.6 | |
10 months ago | about 1 month ago | |
Java | C++ | |
MIT License | Universal Permissive License v1.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
differential-datalog
- DDlog: A programming language for incremental computation
-
Feldera – a more performant streaming database based on Z-sets
Hi,
> I wonder if it lives up to the hype.
We do think so! (disclaimer: I'm a co-founder at Feldera)
To give some more background: We are co-designing/trialing feldera with several industry/enterprise partners from different domains. Our core team also built differential datalog (https://github.com/vmware/differential-datalog) in the past. And while ddlog is used quite successfully in products today, we believe the many lessons we learned with ddlog will help us to build an even better continuous analytics platform. FYI our code is open-source at https://github.com/feldera/feldera if you'd like to try it out.
Also feel free to join our community slack channel (https://www.feldera.com/slack/) if you have more questions.
-
Why Are There No Relational DBMSs? [pdf]
The relational model (and generally working at the level of sets/collections, instead of the level of individual values/objects) actually makes it easier to have this kind of incremental computation in a consistent way, I think.
There's a bunch of work being done on making relational systems work this way. Some interesting reading:
- https://www.scattered-thoughts.net/writing/an-opinionated-ma...
- https://materialize.com/ which is built on https://timelydataflow.github.io/differential-dataflow/, which has a lot of research behind it
- Which also can be a compilation target for Datalog: https://github.com/vmware/differential-datalog
- Some prototype work on building UI systems in exactly the way you describe using a relational approach: https://riffle.systems/essays/prelude/ (and HN discussion: https://news.ycombinator.com/item?id=30530120)
(There's a lot more too -- I have a hobby interest in this space, so I have a small collection of links)
-
Differential Datalog: a programming language for incremental computation
Tutorial which I didn’t see linked in the README: https://github.com/vmware/differential-datalog/blob/master/d...
-
Show HN: Cozo – new Graph DB with Datalog, embedded like SQLite, written in Rust
This is amazing!
Have you looked at differential-datalog? It's rust-based, maintained by VMWare, and has a very rich, well-typed Datalog language. differential-datalog is in-memory only right now, but could be ideal to integrate your graph as a datastore or disk spill cache.
https://github.com/vmware/differential-datalog
-
Help wanted!
Sort of related, in my mind at least, is differential dataflow, e.g. https://github.com/vmware/differential-datalog
-
Datalog in JavaScript
It’s fascinating to see so many different parties converging on Datalog for reactive apps & UI.
- There are several such talks at https://www.hytradboi.com/ (happening this Friday)
- Roam Research and its clones Athens, Logseq, use Datascript / ClojureScript https://github.com/tonsky/datascript
- differential-datalog isn’t an end-to-end system, but is highly optimized for quick reactivity https://github.com/vmware/differential-datalog
- Datalog UI is a Typescript port of some of differential-datalog’s ideas https://datalogui.dev/
-
Call for Help - Open Source Datom/EAV/Fact database in Rust.
Rust related https://github.com/vmware/differential-datalog
-
Anything like Svelte/Jetpack Compose for Haskell?
Actually, that makes me wonder whether or not differential datalog falls under that umbrella, and if it could be applied in the same way Compose is.
souffle
-
Not all Graphs are Trees
There's Souffle[1] that can synthesize C++ for you that you then compile with the rest of your C++.
[1]: https://souffle-lang.github.io/
-
A Logic Language for Distributed SQL Queries
> In fact, we could have used Datalog to achieve our data goals — but that would mean we have to build our own Datalog implementation, backing data store, etc. We don’t want to do that.
Surprising that creating a whole new language made more sense then a backend. I wonder if they did a proof of concept with an existing logic system like Souffle¹ or Rel² first.
¹ https://github.com/souffle-lang/souffle
² https://relational.ai/blog/rel
-
Using_Prolog_as_the_AST
Consider using Datalog (the incredible subset of Prolog) for this perfect use case. Compared to Prolog, you get:
1. Free de-duplication. No more debugging why a predicate is returning the same result more than once.
2. Commutativity. Order of predicates does not change the result. Finally, true logic programming!
3. Easy static analysis. There are many papers that describe how to do points-to analysis (and other similar techniques) with Datalog rules that fit on a single page :O
Souffle[0] is a mature Datalog that is highly performant and has many nice features. I highly recommend playing with it!
[0] https://souffle-lang.github.io
-
If given a list of properties/definitions and relationship between them, could a machine come up with (mostly senseless, but) true implications?
Still, there are many useful tools based on these ideas, used by programmers and mathematicians alike. What you describe sounds rather like Datalog (e.g. Soufflé Datalog), where you supply some rules and an initial fact, and the system repeatedly expands out the set of facts until nothing new can be derived. (This has to be finite, if you want to get anywhere.) In Prolog (e.g. SWI Prolog) you also supply a set of rules and facts, but instead of a fact as your starting point, you give a query containing some unknown variables, and the system tries to find an assignment of the variables that proves the query. And finally there is a rich array of theorem provers and proof assistants such as Agda, Coq, Lean, and Twelf, which can all be used to help check your reasoning or explore new ideas.
-
Introduction to Datalog
It's true that this SPARQL-inspired view of Datalog as a triplestore query language is quite a narrow interpretation compared to something closer to the academic Prolog roots like https://souffle-lang.github.io/ - what do you feel are the most important differences?
- Systematic, Ontological, Undiscovered Fact Finding Logic Engine
- Soufflé • a Datalog Synthesis Tool for Static Analysis
-
Show HN: Cozo – new Graph DB with Datalog, embedded like SQLite, written in Rust
Very cool! I love the sqlite install everywhere model.
Could you compare use case with Souffle? https://souffle-lang.github.io/
I'd suggest putting the link to the docs more prominently on the github page
Is the "traditional" datalog `path(x,z) :- edge(x,y), path(y,z).` syntax not pleasant to the modern eye? I've grown to rather like it. Or is there something that syntax can't do?
I've been building a Datalog shim layer in python to bridge across a couple different datalog systems https://github.com/philzook58/snakelog (including a datalog built on top of the python sqlite bindings), so I should look into including yours
-
Ask HN: What are some interesting examples of Prolog?
TerminusDB CTO here.
Echoing what triska said, CLP(ℤ) and friends are some of the most under-appreciated aspects of prolog implementations.
I'm amazed that programmers still don't have access to CLP when trying to do scheduling and planning solutions.
As an example in practice, what if you want to know about a transaction in which a number of entities transitively had holdings in one of the beneficiaries of the transaction at that particular time. The date window is not known, and the date windows are important in the ownership chain as well as the transactions that are being undertaken.
With CLP(FD) you can ask for a window of time, and the solution will zoom in on an appropriate time window which exists for the entire chain and match the time of the transaction.
Now try to do this query in SQL. It's almost impossibly hard.
I can't wait until I have the time to implement constraint variables for TerminusDB, but at the minute we are still working on more prosaic features.
Aside from that there are very interesting program correctness and optimisation systems which are based on prolog (usually a datalog). For instance Soufflé: https://souffle-lang.github.io
What are some alternatives?
scryer-prolog - A modern Prolog implementation written mostly in Rust.
cozo - A transactional, relational-graph-vector database that uses Datalog for query. The hippocampus for AI!
timely-dataflow - A modular implementation of timely dataflow in Rust
copl-in-prolog - 書籍「プログラミング言語の基礎概念」の Prolog による実装
materialize - The data warehouse for operational workloads.
libredwg - Official mirror of libredwg. With CI hooks and nightly releases. PR's ok
differential-dataflow - An implementation of differential dataflow using timely dataflow on Rust.
crepe - Datalog compiler embedded in Rust as a procedural macro
datalevin - A simple, fast and versatile Datalog database
datascript - Immutable database and Datalog query engine for Clojure, ClojureScript and JS
logica - Logica is a logic programming language that compiles to SQL. It runs on Google BigQuery, PostgreSQL and SQLite.
pycozo - The Python client and Jupyter helper for CozoDB