DataflowTemplates
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks (by GoogleCloudPlatform)
janusgraph
JanusGraph: an open-source, distributed graph database (by JanusGraph)
DataflowTemplates | janusgraph | |
---|---|---|
4 | 6 | |
1,092 | 5,096 | |
1.1% | 0.6% | |
9.8 | 9.3 | |
3 days ago | 6 days ago | |
Java | Java | |
Apache License 2.0 | GNU General Public License v3.0 or later |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
DataflowTemplates
Posts with mentions or reviews of DataflowTemplates.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-04-05.
-
Which Database to use for rest api
Google provide a Dataflow template for copying from BigQuery to Datastore, see this stack overflow answer.
- Sync Postgres to BigQuery, possible? How?
-
New to GCP - need help designing pipeline from production Heroku Postgres to BigQuery
Ah, looks like the template default appends new rows. If I want to overwrite the table, looks like I might be able to just replace this line in the template code to WRITE_TRUNCATE (see here). Cool!
-
Tricky Dataflow ep.1 : Auto create BigQuery tables in pipelines
However, learning to use Apache Beam, which is the open source framework behind Dataflow, is no bed of roses: The official documentation is sparse, GCP-provided templates don't work out-of-the-box, and the Javadoc is, well, a javadoc.
janusgraph
Posts with mentions or reviews of janusgraph.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-29.
-
Graph Databases vs Relational Databases: What and why?
First, you need to choose a specific graph database platform to work with, such as Neo4j, OrientDB, JanusGraph, Arangodb or Amazon Neptune. Once you have selected a platform, you can then start working with graph data using the platform's query language.
-
Getting Started with Redis and RedisGraph
JanusGraph
- JanusGraph: an open-source, distributed graph database
-
JanusGraph – Distributed, open source, scalable graph database
There were a couple years where it was mostly abandoned. Good to see this solid graph database being well maintained. the milestones[1] mostly show a lot of upgrading libraries, some enhancements/features sprinkled in, but for a while Janus was nearly abandoned.
Maintenance re-started in 2017, with IBM & Google stepping up to back it[2].
[1] https://github.com/JanusGraph/janusgraph/milestones?state=cl...
[2] https://architecht.io/google-ibm-back-new-open-source-graph-...
-
QOMPLX: Using Scylla with JanusGraph for Cybersecurity
QOMPLX partnered with the graph database experts at Expero to implement their system with JanusGraph, which uses Scylla as an underlying fast and scalable storage layer. We had the privilege to learn from their use case at Scylla Summit this January, which we share with you today.
-
Installing Apache Cassandra for JanusGraph
At the time of writing this article, JanusGraph's latest release page on GitHub says that JanusGraph is compatible with Cassandra 3.11.0. So I will get this version's download link from the Apache Cassandra archive, and I will use the wget shell command to download it to my /opt directory. Then I will use the tar command to extract the contents of the downloaded archive.
What are some alternatives?
When comparing DataflowTemplates and janusgraph you can also consider the following projects:
pgsink - Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
Neo4j - Graphs for Everyone