Top 23 Science and Data analysis Open-Source Projects

• Pandas

  14 28,657 10.0 Python

  Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

  Project mention: VBA vs. Power BI | reddit.com/r/FPandA | 2021-03-01

  VBA is used for writing up scripts that will automate some process in Excel. VBA performance is incredibly slow and honestly, terrible. You're better off learning some programming (Python) and libraries that will allow you to manipulate/clean/data wrangle. Look into pandas.

• NumPy

  18 16,428 9.9 Python

  The fundamental package for scientific computing with Python.

  Project mention: Making A Synthesizer Using Python | reddit.com/r/Python | 2021-03-02

  What do you mean by uploads? If you mean additional libraries besides Python then, for control input you need the midi module from pygame and for audio output pyaudio. Other than that numpy, you can install these using pip.

• Scout

  Sponsored scoutapm.com

  Get performance insights in less than 4 minutes. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

• PredictionIO

  0 12,500 0.0 Scala

  PredictionIO, a machine learning server for developers and ML engineers.

• NetworkX

  3 8,731 9.4 Python

  Network Analysis in Python

  Project mention: [P] I made Communities: a library of clustering algorithms for network graphs (link in comments) | reddit.com/r/MachineLearning | 2021-02-22

  It would be nice that communities natively supports both networkx and igraph data structures.

• Dask

  2 7,965 9.5 Python

  Parallel computing with task scheduling

  Project mention: Too much data to preprocess to work with pandas — is pyspark.sql a feasible alternative? | reddit.com/r/PySpark | 2021-02-25

  I haven't used it myself I have to admit, but I think dask could fit your workflow. Spark might add a little bit too much overhead if you're not used to it and you're not using a distributed system but of course it would also work.

• SciPy

  4 7,955 0.0 Python

  Scipy library main repository

  Project mention: I’m never updating Scipy | reddit.com/r/physicsmemes | 2021-01-26

  Link: https://github.com/scipy/scipy/releases

• SymPy

  8 7,866 9.9 Python

  A computer algebra system written in pure Python

  Project mention: Python Math Library made in 3 Days as a 14 year-old - libmaths | reddit.com/r/Python | 2021-02-23

  Now compare that to SymPy: https://github.com/sympy/sympy/blob/9e8f62e059d83178c1d8a1e19acac5473bdbf1c1/sympy/ntheory/primetest.py#L472-L634

• Numba

  9 6,153 9.9 Python

  NumPy aware dynamic Python compiler using LLVM

  Project mention: I need help to speed up my program! | reddit.com/r/learnpython | 2021-03-02

  The first thing I would do is write the code in a non-vectorized fashion to see where I could get rid of any unnecessary copying/allocating. Then you could rewrite the code using a more efficient sequence of vectorized operations, or you could JIT it using a library like numba

• statsmodels

  1 6,056 9.3 Python

  Statsmodels: statistical modeling and econometrics in Python

  Project mention: [C] I have an MS in Statistics - how can I get better at coding? | reddit.com/r/statistics | 2021-01-04

• PyMC

  0 5,594 9.2 Python

  Probabilistic Programming in Python: Bayesian Modeling and Probabilistic Machine Learning with Theano

• Zeppelin

  0 5,150 9.2 Java

  Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

• gonum

  1 4,617 8.9 Go

  Gonum is a set of numeric libraries for the Go programming language. It contains libraries for matrices, statistics, optimization, and more

  Project mention: Loop elimination | reddit.com/r/golang | 2021-01-04

  I'm not sure what exactly you are trying to accomplish, but there are already numeric packages https://github.com/gonum/gonum that has asm loops for the common stuff. And there's https://github.com/mmcloughlin/avo that makes working with assembly less painful.

• BigDL

  0 3,702 6.3 Scala

  BigDL: Distributed Deep Learning Framework for Apache Spark

• Breeze

  0 3,221 4.2 Scala

  Breeze is a numerical processing library for Scala.

• Spark Notebook

  0 3,015 0.0 JavaScript

  Interactive and Reactive Data Science using Scala and Spark.

• blaze

  0 2,928 0.0 Python

  NumPy and Pandas interface to Big Data

• astropy

  0 2,642 9.9 C

  Repository for the Astropy core package

• orange

  1 2,637 9.7 Python

  🍊 :bar_chart: :bulb: Orange: Interactive data analysis

  Project mention: Informatica per la SCIENZA, per un ignorante in materia. | reddit.com/r/ItalyInformatica | 2021-02-28

• Biopython

  1 2,619 9.5 Python

  Official git repository for Biopython (originally converted from CVS)

  Project mention: How is computer science used in biotechnology? | reddit.com/r/biotech | 2021-02-21

  You probably mean genetic engineering, which also uses a lot of software tools. The latest iteration, called synthetic biology, also relies heavily on computer-assisted DNA design, cloning and modelling of gene expression networks. You may check out Biopython, the Synthetic Biology Open Language (SBOL), the GBA software, or CUBA for examples of software used in synbio.

• Algebird

  0 2,038 7.9 Scala

  Abstract Algebra for Scala

• Stats

  0 1,922 4.3 Go

  A well tested and comprehensive Golang statistics library package with no dependencies.

• Interactive Parallel Computing with IPython

  0 1,899 2.4 Python

  Interactive Parallel Computing in Python

• gonum/plot

  0 1,828 7.0 Go

  A repository for plotting and visualizing data

Index