mlpack VS NumPy

Does C++ have the equivalent of Pandas or Apache Spark? Are there extensive libraries that exist/are being developed that allow you to perform operations with data? Or do people just use a combination of Python & its various libraries (NumPy etc)? If we leave aside the data bit, are there libraries that allow you to develop ML models in C++ (mlpack for instance ) faster & more efficiently compared to their Python counterparts (scikit-learn)? On a more general note, how does C++ fit into the routine of a Quant Researcher? And at what scale does an organization decide they need to start switching to other languages and spend more time developing the code ?

mlpack is a great library for machine learning in C++. It's very fast and not too much of a learning curve.

This toolkit was originally part of the mlpack machine learning library (https://github.com/mlpack/mlpack) before it was split out into a separate, standalone effort.

Github Repository: https://github.com/mlpack/mlpack Developed By: Community, supported by Georgia Institute of technology Primary purpose: Multiple ML Models and Algorithms

In NumPy with @, dot() or matmul():

In NumPy with * or multiply(). ` or multiply()` can multiply 0D or more D arrays by element-wise multiplication.

Data science projects often use numpy. However, numpy objects are not JSON-serializable and therefore require conversion to standard python objects in order to be saved:

numpy: A library for scientific computing in Python

Python has become a preferred language for data analysis due to its simplicity and robust library ecosystem. Among these, NumPy stands out with its efficient handling of numerical data. Let’s say you’re working with numbers for large data sets—something Python’s native data structures may find challenging. That’s where NumPy arrays come into play, making numerical computations seamless and speedy.

I was looking at all the big projects like numpy, pytorch, flask, etc.

I wish the NumPy devs would more thoroughly consider adding full fluent API support, e.g. x.sqrt().ceil(). [Issue #24081]