GraphScope
v6d
Our great sponsors
GraphScope | v6d | |
---|---|---|
10 | 5 | |
3,101 | 800 | |
0.8% | 1.4% | |
9.7 | 9.5 | |
1 day ago | 3 days ago | |
C++ | C++ | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
GraphScope
-
Show HN: Graphlearn-for-PyTorch, distributed graph learning on PyTorch
Optimizing distributed sampling and feature lookup looks really attractive. It's really challenging to deploy GNN training at an industrial-scale for a large graph.
Will GLT be part of graphscope[1] and replacing the current graphscope-for-learning implementation?
- GitHub “allows” unauthorized users “merging” PRs, bypass write permission check
-
GraphScope VS CXXGraph - a user suggested alternative
2 projects | 17 Mar 2022
-
GraphScope on Colab: Large-Scale Graph Computing from Notebooks to Kubernetes
We are glad to announce the landing of GraphScope on Colab: https://colab.research.google.com/github/alibaba/GraphScope.
GraphScope is a one-stop graph computing systems from Alibaba aimed to address challenges in large-scale graph computation in real production environments. GraphScope releases v0.9, enabling data scientists to develop graph computing workflows for analytical, interactive query and GNN workloads on small graphs in jupyter notebooks in a interactive manner. Once finishing the development and debugging, users can easily deployed their workflows to Kubernetes with one-line change!
To try GraphScope, you could find it on Colab[1], Jupyter Hub[2], or install GraphScope to your environment using pip by:
pip3 install graphscope
For more details of our v0.9 release, please refer to https://github.com/alibaba/GraphScope/releases/tag/v0.9.0
[1]: https://colab.research.google.com/github/alibaba/GraphScope/...
- GraphScope v0.6 Released: Code with Eager, Executive with Lazy
-
GraphScope: A One-Stop Large-Scale Graph Computing System
Thanks for you interests on GraphScope!
We do have a concrete plan for k8s-less deployment and we already have an issue [1] to track that. That will be available before the end of March 2021.
To simplify the environment setup process we will release a docker image for end-users, but without docker will be ok as well (requires building from sources).
GraphScope use vineyard [2] as the storage layer for im-memory graph data structures. And current the graph type (aka. ArrowPropertyFragment in GraphScope) uses a set of arrow tables and arrays under the hood.
GraphScope supports a `to_vineyard_dataframe` method on the computation context [3]. We also has a plan for integration between vineyard and dask (may could be delivered in March as well). At that time the interop between dask would be straightforward.
[1]: https://github.com/alibaba/GraphScope/discussions/113
[2]: https://github.com/alibaba/libvineyard
[3]: https://graphscope.io/docs/reference/context.html#graphscope...
GraphScope is a unified distributed graph computing platform that provides a one-stop environment for performing diverse graph operations on a cluster of computers through a user-friendly Python interface. GraphScope makes multi-staged processing of large-scale graph data on compute clusters simple by combining several important pieces of Alibaba technology for analytics, interactive, and graph neural networks (GNN) computation, respectively, and the vineyard store that offers efficient in-memory data transfers.
We just released the version 0.2.0. And along with the release, we launched a public JupyterLab service where you can have a try in your browser: https://try.graphscope.app
Github: https://github.com/alibaba/graphscope. (stars are welcome :)
v6d
-
Has anyone here had experience using Vineyard?
Brief Overview for any interested: Vineyard (v6d) is an in-memory immutable data manager that provides out-of-the-box high-level abstraction and zero-copy in-memory sharing for distributed data in big data tasks, such as graph analytics (e.g., GraphScope), numerical computing (e.g., Mars), and machine learning.
-
GitHub “allows” unauthorized users “merging” PRs, bypass write permission check
- https://github.com/v6d-io/v6d/pull/948
-
[P] Bridging Dask and Tensorflow for distributed machine learniing with Vineyard
We propose vineyard, https://github.com/v6d-io/v6d to address such challenges, which, provides efficient zero-copy data sharing between different compute engines, without extra cost of copying and serialization, compared other similar solutions.
- Vineyard 0.2.7: Airflow, Dask, and better ML experience
- Vineyard v0.2.0: big-data applications optimization on Kubernetes
What are some alternatives?
janusgraph - JanusGraph: an open-source, distributed graph database
cpp-ipc - C++ IPC Library: A high-performance inter-process communication using shared memory on Linux/Windows.
indradb - A graph database written in rust
shadesmar - Fast C++ IPC using shared memory
libvineyard - vineyard (v6d): an in-memory immutable data manager. [Moved to: https://github.com/alibaba/v6d]
zef - Toolkit for graph-relational data across space and time
euler - A distributed graph deep learning framework.
iceoryx - Eclipse iceoryx™ - true zero-copy inter-process-communication
MPAndroidChart - A powerful 🚀 Android chart view / graph view library, supporting line- bar- pie- radar- bubble- and candlestick charts as well as scaling, panning and animations.
pe-util - List shared object dependencies of a portable executable (PE)
sonic - 🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.
ecal - 📦 eCAL - enhanced Communication Abstraction Layer. A high performance publish-subscribe, client-server cross-plattform middleware.