db
Zeppelin
| db | Zeppelin | |
|---|---|---|
| 1 | 8 | |
| 173 | 6,263 | |
| 0.0% | 0.2% | |
| 0.0 | 8.7 | |
| almost 2 years ago | 7 days ago | |
| Java | Java | |
| GNU Affero General Public License v3.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
db
-
Freqfs: In-memory filesystem cache for Rust
We actually did work on this a few years ago but did not get enough takers for it. We created a one size fits all database, that leverages the full capability of the file system.
Try it here: https://github.com/blobcity/db
PS: I am the chief architect of the DB, and the project is no longer being actively maintained by us. But if you make a contribution, we will oblige to review and merge a PR.
Bottom line, nothing you do can make your database faster than the filesystem. So why not make a database that just uses the filesystem to the fullest, than creating a filesystem on top of a filesystem. BlobCity DB does not create a secondary filesystem. It dumps all data directly to the filesystem, thereby giving peak filesystem performance. This is scientifically really the best it gets from a performance standpoint. Not necessarily the most efficient in data storage / data-compression standpoint.
This means, we gain speed, while compromising on data-compression. We produce a larger storage footprint, but are insanely fast. Storage is cheap, compute isn't. So that should be okay I suppose.
Zeppelin
-
Serverless Apache Zeppelin on AWS
Now we can proceed with the definition of Apache Zeppelin. It is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with Python, Scala, SQL, Spark, and more. You can execute code and even schedule a job (via cron) to run at regular intervals.
-
Visualization using Pyspark Dataframe
Have you tried Apache Zepellin I remember that you can pretty print spark dataframes directly on it with z.show(df)
-
Fast CSV Processing with SIMD
I used to use Zeppelin, some kind of Jupyter Notebook for Spark (that supports Parquet). But it may be better alternatives.
https://zeppelin.apache.org/
-
What libraries do you use for machine learning and data visualizing in scala?
Another more widely used notebooks for scala and spark: https://zeppelin.apache.org/
-
How to use IPython in Apache Zeppelin Notebook
[1] Apache Zeppelin http://zeppelin.apache.org/ [2] Zeppelin notebooks website http://zeppelin-notebook.com/. [3] Zeppelin notebooks git repo https://github.com/zjffdu/zeppelin-notebook
-
BI Application in Golang.
Apache Zeppelin
-
Using InterSystems Caché and Apache Zeppelin
For all who think: What the heck is Apache Zeppelin? Here are some details what the project site says:
-
Is there a way to collaborate in real-time for Jupyter Notebooks?
Check out Zeppelin. It's similar to Jupyter and allows real-time editing by multiple users. https://zeppelin.apache.org/
What are some alternatives?
freqfs - An in-memory filesystem cache layer based on tokio::fs, with least-frequently-used eviction
Breeze - Breeze is a numerical processing library for Scala.
openEtG
Spark Notebook - Interactive and Reactive Data Science using Scala and Spark.
memmap-rs - cross-platform Rust API for memory mapped IO
Algebird - Abstract Algebra for Scala
Figaro - Figaro Programming Language and Core Libraries
BigDL - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.
Smile - Statistical Machine Intelligence & Learning Engine
PredictionIO - PredictionIO, a machine learning server for developers and ML engineers.
OpenMOLE - Workflow engine for exploration of simulation models using high throughput computing
OscaR