fugue
Mermaid
Our great sponsors
| fugue | Mermaid | |
|---|---|---|
| 11 | 90 | |
| 1,876 | 3,562 | |
| 2.3% | 5.4% | |
| 6.7 | 9.1 | |
| 7 days ago | 5 days ago | |
| Python | TypeScript | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fugue
- FLaNK Stack Weekly 22 January 2024
-
Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
Please integrate it with Fugue.
https://github.com/fugue-project/fugue
- Fugue: A unified interface for distributed computing
- [Discussion] Open Source beats Google's AutoML for Time series
- Ask HN: How do you test SQL?
-
Replacing Pandas with Polars. A Practical Guide
Fugue is an interesting library in this space , though I haven’t tried it
https://github.com/fugue-project/fugue
A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark, Dask and Ray without any rewrites.
-
The hand-picked selection of the best Python libraries and tools of 2022
fugue — distributed computing done easy
-
[P] Open data transformations in Python, no SQL required
This looks similar to fugue, am I right? How do they compare?
-
What the Duck?!
I am looking forward to how Substrait could help removing this friction. It aims to provide a standardised intermediate query language (lower level than SQL) to connect frontend user interfaces like SQL or data frame libraries with backend analytical computing engines. It is linked to the Arrow ecosystem. Something like Ibis or Fugue could become the front and DuckDB the backend engine.
-
Pyspark now provides a native Pandas API
There's dask-sql, but I think it is being abandoned for fugue-project. I'm actually excited for this project as it is trying to provide a backend agnostic solution, which would seem like a difficult, lofty goal. I wish them luck.
Mermaid
- Conquering System Design Diagrams: My Shift to Mermaid.js
- Mermaid Live Editor
- Mermaid Chart, a Markdown-like tool for creating diagrams, raises $7.5M
-
Using Mermaid JS to generate a diagram from Power Automate
Mermaid JS is a tool that lets you create diagrams and charts such as flowcharts, sequence diagrams, Gantt charts using simple text commands. It works by converting your text commands into a graphical representation that you can customize and share. https://mermaid.live/
- FLaNK Stack Weekly 22 January 2024
-
LLMs and Programming in the first days of 2024
I'm not OP, but I just ask GPT to turn code or process or whatever else into a mermaid diagram. Most of the time I don't even need to few-shot prompt it with examples. Then you dump the resulting text into something like https://mermaid.live/ and voilà.
-
Open-source drawing tool – Excalidraw
I like excalidraw for live discussions but if I want to make more detailed or better looking diagrams, I really enjoy these two tools:
- For drag-and-drop/WYSIWYG, I really like DrawIO. They have a web version https://app.diagrams.net/ but I strongly recommend the desktop version https://github.com/jgraph/drawio-desktop/releases/
- For text-as-diagram, I think Mermaid wins this by default since GitHub added markdown support for these: https://mermaid.live/ (This was github's announcement https://github.blog/2022-02-14-include-diagrams-markdown-fil... )
-
I lost a full day's work thanks to Mermaid.
After hours without being able to solve this problem, I decided to make the chart directly in Mermaid's live editor and export it to PNG and SVG. The big problem is that the letters are still too small, the quality of the PNG is very low, and the SVG only works on the web, not with other applications like PowerPoint and Inkscape.
-
Nomnoml
You can export to PNG and other formats in the Mermaid editor https://mermaid.live/
-
Creating mindmaps with ChatGPT
Copy paste code here: https://mermaid.live
What are some alternatives?
modin - Modin: Scale your Pandas workflows by changing a single line of code
plantuml - Generate diagrams from textual description
data-science-ipython-notebooks - Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
kroki - Creates diagrams from textual descriptions!
Optimus - :truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
obsidian-releases - Community plugins list, theme list, and releases of Obsidian.
mlToolKits - learningOrchestra is a distributed Machine Learning integration tool that facilitates and streamlines iterative processes in a Data Science project.
golang-nextjs-portable - Go program with embedded Next.js app.
xarray - N-D labeled arrays and datasets in Python
DrawThe.Net - drawthe.net draws network diagrams dynamically from a text file describing the placement, layout and icons. Given a yaml file describing the hierarchy of the network and it's connections, a resulting diagram will be created.
ploomber - The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
wavedrom - :ocean: Digital timing diagram rendering engine