nebula
dtale
Our great sponsors
nebula | dtale | |
---|---|---|
9 | 46 | |
150 | 4,550 | |
2.0% | 2.2% | |
7.4 | 8.1 | |
about 2 months ago | 1 day ago | |
C++ | TypeScript | |
Apache License 2.0 | GNU Lesser General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nebula
-
Show HN: Turn any data into a fast analytical API
we use our in-house baked engine - open sourced here https://github.com/varchar-io/nebula
Yeah, Tinybird has lots of similarities, I will do more research on it, thanks for the reference.
- Show HN: Visualize your streaming data in real-time
-
How would you build a BI platform that delivers "real time" insights to users on their smartphones and computer devices in a company of about 200 people?
Take a look at this open source project - it may be helpful - https://github.com/varchar-io/nebula
-
Streaming multi-file SQL and CSV/TSV/etc., native/WASM and fastest CSV parser
cool - I also hand crafted a CSV parser following RFC4180 a while ago, not sure if you have a repeatable way to benchmark the performance difference?
https://github.com/varchar-io/nebula/blob/master/src/storage...
-
Looking for a recommendation for basic, cloud or server based reporting.
- if you look for hosting solution by yourself, bringing up a nebula cluster (even a single node) is simple, check out https://github.com/varchar-io/nebula
- Introduce an open-source project in data engineering
-
How is Elasticsearch similar to MongoDB in terms of data storage and usage?
Many modern data systems are designed in a similar way - extract, index, and query in including many low-latency real-time analytical systems, such as clickhouse, druid, pinot, nebula. Take nebula (https://github.com/varchar-io/nebula) as an example - it connects real-time storage engines like Kafka, cloud storage, or pubsub systems, extracts and index data from message queue into its own distributed system, providing low latency query on top of it for business use cases.
- Extremely-Fast Interactive Big Data Analytics
dtale
-
The free pandas visualizer, D-Tale, has now been integrated with ArcticDB which will allow users to load huge datasets and easily navigate their databases
[D-Tale](https://github.com/man-group/dtale) has recently released version 3.2.0 on pypi & conda-forge: ``` pip install -U dtale conda install dtale -c conda-forge ``` But if you want to take it one step further you can now integrate it with [ArcticDB](https://github.com/man-group/ArcticDB): ``` pip install -U dtale[arcticdb] ``` This allows you the ability to navigate your libraries of datasets saved to your ArcticDB database! But the best part is that all the reads are occuring directly against ArcticDB so some of the memory constraints you may have been hit with before are now a thing of the past. Here's a full write up how to use this functionality along with a quick demo: https://github.com/man-group/dtale/blob/master/docs/arcticdb/ARCTICDB\_INTEGRATION.md Hope this helps & please support open-source by throwing your star on the [repo](https://github.com/man-group/dtale). Thanks! 🙏
-
Data Scientists using neovim: how do you explore dataframes?
I've looked into external tooling, libs such as dtale, which feel overly complicated for my use case (but I'm open to alternatives). What I would like to have instead is something akin to Spyder's variable viewer, which allows sorting by column. VSCode goes a step further and also provides the ability to filter the dataframe.
-
I need help lol
D-Tale: A Python library that provides an interactive web-based interface for data exploration and analysis.
-
Something better than pandas? with interactive graphical UI?
Try this: https://github.com/man-group/dtale
-
Mito – Excel-like interface for Pandas dataframes in Jupyter notebook
https://github.com/man-group/dtale
I find that I'm actually a lot faster using basic Pandas methods to get the data I want in exactly the form I want it.
If I really want to show everything, I just use:
'''
- Memray is a memory profiler for Python by Bloomberg
- Show HN: D-Tale, easy to use pandas GUI
-
Added visualizations of statsmodels time series analysis functions to the free pandas visualizer, D-Tale
Just added "Time Series Analysis" in v1.60.1 of D-Tale on pypi & conda-forge: pip install -U dtale conda install dtale -c conda-forge This feature provides a quick and easy way to visualize the usage of the following time series analysis function in statsmodels:
- Show HN: Open-source pandas dataframe visualizer
-
For all the python/pandas users out there I just released a bunch of UI updates to the free visualizer, D-Tale
Your data is stored in memory so the size of your dataframe is limited to the memory of your machine. That being said we’ve allowed users to swap out the machanism which stores the data so you can use something like Redis or Shelve to allieviate memory. Here’s some documentation: https://github.com/man-group/dtale/blob/master/docs/GLOBAL_STATE.md
What are some alternatives?
AlphaPlot - :chart_with_upwards_trend: Application for statistical analysis and data visualization which can generate different types of publication quality 2D and 3D plots with extensive visual customization.
PandasGUI - A GUI for Pandas DataFrames
zsv - zsv+lib: world's fastest (simd) CSV parser, bare metal or wasm, with an extensible CLI for SQL querying, format conversion and more
ydata-profiling - 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
rpc-websockets - JSON-RPC 2.0 implementation over WebSockets for Node.js and JavaScript/TypeScript
jupyterlab-autoplot - Magical Plotting in JupyterLab
covid-19 - COVID-19 World is yet another Project to build a Dashboard like app to showcase the data related to the COVID-19(Corona Virus).
pandastable - Table analysis in Tkinter using pandas DataFrames.
oneDAL - oneAPI Data Analytics Library (oneDAL)
sqliteviz - Instant offline SQL-powered data visualisation in your browser
pachyderm - Data-Centric Pipelines and Data Versioning
best-of-ml-python - 🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.