The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more ā
Top 23 Science and Data analysis Open-Source Projects
-
Pandas
Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
-
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
-
-
gonum
Gonum is a set of numeric libraries for the Go programming language. It contains libraries for matrices, statistics, optimization, and more
-
Zeppelin
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
-
BigDL
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.
-
-
-
-
-
-
-
Stats
A well tested and comprehensive Golang statistics library package with no dependencies. (by montanaflynn)
-
-
Interactive Parallel Computing with IPython
IPython Parallel: Interactive Parallel Computing in Python
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Dash is a Python framework that enables you to build interactive frontend applications without writing a single line of Javascript. Internally and in projects we like to use it in order to build a quick proof of concept for data driven applications because of the nice integration with Plotly and pandas. For this post, I'm going to assume that you're already familiar with Dash and won't explain that part in detail. Instead, we'll focus on what's necessary to make it run serverless.
In NumPy with @, dot() or matmul():
Built from this data... https://github.com/networkx/networkx/blob/main/examples/grap...
I guess it is a rite of passage to rewrite it. I'm doing it for SciPy too together with Propack in [1]. Somebody already mentioned your repo. Thank you for your efforts.
[1]: https://github.com/scipy/scipy/issues/18566
Project mention: AutoCodeRover resolves 22% of real-world GitHub in SWE-bench lite | news.ycombinator.com | 2024-04-09Thank you for your interest. There are some interesting examples in the SWE-bench-lite benchmark which are resolved by AutoCodeRover:
- From sympy: https://github.com/sympy/sympy/issues/13643. AutoCodeRover's patch for it: https://github.com/nus-apr/auto-code-rover/blob/main/results...
- Another one from scikit-learn: https://github.com/scikit-learn/scikit-learn/issues/13070. AutoCodeRover's patch (https://github.com/nus-apr/auto-code-rover/blob/main/results...) modified a few lines below (compared to the developer patch) and wrote a different comment.
There are more examples in the results directory (https://github.com/nus-apr/auto-code-rover/tree/main/results).
Project mention: Show HN: Use an "eraser" to clean data on flight without breaking your workflow | news.ycombinator.com | 2024-03-15
Around the same time, I discovered Numba and was fascinated by how easily it could bring huge performance improvements to Python code.
But if you want to see what can be done for numeric stuff, check out gonum. Personally, I still wouldn't use Go, and I rather suspect it's still pretty easy to reach for something like what you're trying to do and not find it because Go just can't write that type sensibly, but you can at least see what is available, written by people who disagree with me about Go not being a great language for this.
Now we can proceed with the definition of Apache Zeppelin. It is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with Python, Scala, SQL, Spark, and more. You can execute code and even schedule a job (via cron) to run at regular intervals.
Any performance benchmark against intel's 'IPEX-LLM'[0] or others?
[0] - https://github.com/intel-analytics/ipex-llm
I know I've tooted its horn before, but Orange3 is a pretty neat Python-based GUI platform that makes this and a metric buttload of other statistical/ML techniques available to non-programmer types.
Just watch out for null character `x00` in the corpus. That always seems to kill it stone dead.
https://orangedatamining.com/
https://orange3.readthedocs.io/projects/orange-visual-progra...
Astropy [0] lives at the heart of most work. It has a Python interface, often backed by Fortran and C++ extension modules. If you use Astropy, you're indirectly using libraries like ERFA [6] and cfitsio [7] which are in C/Fortran.
I personally end up doing a lot of work that uses the HEALPix sky tesselation, so I use healpy [2] as well.
Openorb is perhaps a good example of a pure-Fortran package that I use quite. frequently for orbit propagation [3].
In C, there's Rebound [4] (for N-body simulations) and ASSIST [5] (which extends Rebound to use JPL's pre-calculated positions of major perturbers, and expands the force model to account for general relativity).
There are many more, these are just ones that come to mind from frequent usage in the last few months.
[0] https://www.astropy.org/
Project mention: Blaze: Fast query execution engine for Apache Spark | news.ycombinator.com | 2023-10-19Unfortunate name overlap with an under-loved PyData project: https://blaze.pydata.org
Project mention: The Golang Saga: A Coderās Journey There and Back Again. Part 3: The Graphing Conundrum | dev.to | 2023-08-16And with this map now we are ready to create a group bar chart for each station to find out which station is the best for each type of value. I found a helpful tutorial on gonum/plot, so Iām going to use plotter.NewBarChart for my purposes.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Science and Data analysis related posts
- Hierarchical Clustering
- Orange Data Mining
- AutoCodeRover resolves 22% of real-world GitHub in SWE-bench lite
- LLaMA Now Goes Faster on CPUs
- PyTorch Library for Running LLM on Intel CPU and GPU
- The Graph of Wikipedia [video]
- Dot vs Matrix vs Element-wise multiplication in PyTorch
-
A note from our sponsor - WorkOS
workos.com | 26 Apr 2024
Index
What are some of the best open-source Science and Data analysis projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Pandas | 41,923 |
| 2 | NumPy | 26,360 |
| 3 | NetworkX | 14,178 |
| 4 | SciPy | 12,431 |
| 5 | SymPy | 12,384 |
| 6 | Dask | 11,999 |
| 7 | pygwalker | 9,759 |
| 8 | statsmodels | 9,534 |
| 9 | Numba | 9,432 |
| 10 | PyMC | 8,155 |
| 11 | gonum | 7,260 |
| 12 | Zeppelin | 6,263 |
| 13 | BigDL | 5,910 |
| 14 | orange | 4,604 |
| 15 | astropy | 4,210 |
| 16 | Biopython | 4,167 |
| 17 | Breeze | 3,437 |
| 18 | blaze | 3,182 |
| 19 | Spark Notebook | 3,147 |
| 20 | Stats | 2,881 |
| 21 | gonum/plot | 2,631 |
| 22 | Interactive Parallel Computing with IPython | 2,551 |
| 23 | RDKit | 2,413 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com