magicl VS cl-ana

(Link didn't work for me)

https://github.com/quil-lang/magicl/blob/master/src/high-lev...

use MAGICL. [1] It is optionally and transparently accelerated by BLAS/LAPACK.

[1] https://github.com/quil-lang/magicl/blob/master/doc/high-lev...

Maybe have a look at how magicl does this?

This is essentially the first option, which is already supported by MAGICL by loading MAGICL/EXT-LAPACK [1].

[1] https://github.com/quil-lang/magicl#extensions

I think what the magicl team has done is brilliant - allowing multiple implementations is awesome.

Second up is magicl, especially useful if performance is a concern. This might not be as extensive as numcl, but it's been battle tested in the industry over the last decade or so. Because this uses generic functions, so long as you are using not-very-small arrays, performance should not be a concern for you. And even if you are, you could write your own functions that use the low-level functions that magicl's backends define. Otherwise performance can be at par with numpy.

This Dev How-To describes (I hope in enough detail) how to add these specialized routines to MAGICL.

I agree... and I do don't want be the person who has not rallied. I just took a look at guicho's issue from 2019. And here, you yourself have admitted that the high level interface is less than ideal and needs more work. However, the very point that magicl is an industry standard could imply that potentially radical backward-incompatible changes can be hard. But, honestly, I want to discuss this, time permitting!

Common Lisp is a great language to build new tools for data science, but currently has pretty awful library support existing data science workflows. Common Lisp is sorely lacking in high-quality statistics, plotting, and sparse arrays. There’s been a long work-in-progress library to bring flexible and high-performance linear algebra to Lisp, but it needs more contributors.

I understand what you mean; but despite CL appearing as a very similar to EL, the trouble would be probably significant due to missing libraries and semantic differences between CL and EL, in case of any significantly sophisticated plotting library, such as cl-ana for example. It is probably easier to port Emacs to CL, than that thing to Emacs :).

There are some other active Lisp efforts in the data science space, such as cl-ana.[1]

[1] https://github.com/ghollisjr/cl-ana

If you like spreadsheets, you may appreciate the Cells library. I haven't used it myself yet, however it is billed as "Spreadsheet-like expressiveness for CLOS, the Common Lisp Object System." I believe cl-ana also implements some spreadsheet-like functionality. This article demonstrates some trivial usage of Cells.

cl-ana - Common Lisp data analysis library with emphasis on modularity and conceptual clarity. It aims to be a general purpose framework for analyzing small and large scale datasets, including binned data analysis and visualization. [GNU GPL3][2].