ldbc_snb_datagen_spark

Synthetic graph generator for the LDBC Social Network Benchmark, running on Spark (by ldbc)

Ldbc_snb_datagen_spark Alternatives

Similar projects and alternatives to ldbc_snb_datagen_spark

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better ldbc_snb_datagen_spark alternative or higher similarity.

ldbc_snb_datagen_spark reviews and mentions

Posts with mentions or reviews of ldbc_snb_datagen_spark. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-04-27.
  • Benchgraph Backstory: The Untapped Potential
    4 projects | dev.to | 27 Apr 2023
    Because of the size, complexity, and feedback from the community, we decided to add a larger dataset. So the next dataset should be large, more complex, and recognizable. The choice was easy here; the industry-leading benchmark group Linked Data Benchmark Council (LDBC), which Memgraph is a part of, has open-sourced the datasets for benchmarking. The exact dataset is the social network dataset. It is a synthetically generated dataset representing a social network. It is being used in LDBC audited benchmarks, SNB interactive, and SNB Buissines intelligence benchmarks. Keep in mind that this is NOT an official implementation of an LDBC benchmark, the open-source dataset is being used as a basis for benchmarks, and it will be used for our in-house testing process and improving Memgraph.
  • Postgres: The Graph Database You Didn't Know You Had
    8 projects | news.ycombinator.com | 31 Mar 2023
    I designed and maintain several graph benchmarks in the Linked Data Benchmark Council, including workloads aimed for databases [1]. We make no restrictions on implementations, they can any query language like Cypher, SQL, etc.

    In our last benchmark aimed at analytical systems [2], we found that SQL queries using WITH RECURSIVE can work for expressing reachability and even weighted shortest path queries. However, formulating an efficient algorithm yields very complex SQL queries [3] and their execution requires a system with a sophisticated optimizer such as Umbra developed at TU Munich [4]. Industry SQL systems are not yet at this level but they may attain that sometime in the future.

    Another direction to include graph queries in SQL is the upcoming SQL/PGQ (Property Graph Queries) extension. I'm involved in a project at CWI Amsterdam to incorporate this language into DuckDB [5].

    [1] https://ldbcouncil.org/benchmarks/snb/

    [2] https://www.vldb.org/pvldb/vol16/p877-szarnyas.pdf

    [3] https://github.com/ldbc/ldbc_snb_bi/blob/main/umbra/queries/...

    [4] https://umbra-db.com/

    [5] https://www.cidrdb.org/cidr2023/slides/p66-wolde-slides.pdf

  • Bullshit Graph Database Performance Benchmarks
    10 projects | news.ycombinator.com | 12 Jan 2023
  • From Data Preprocessing to Using Graph Database
    4 projects | /r/graphdata | 19 Sep 2022
    Pull the source code from https://github.com/ldbc/ldbc_snb_datagen/tree/stable.To generate data for scale factor 1-1000, use the stable branch.
  • A note from our sponsor - WorkOS
    workos.com | 29 Apr 2024
    The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Stats

Basic ldbc_snb_datagen_spark repo stats
5
162
5.0
8 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com