jupyenv VS hasktorch

> There aren't good boundaries between Jupyter's own Python environment, and that of your notebooks— if you have a dependency which conflicts with one of Jupyter's dependencies, then good luck.

I believe that you can use https://github.com/tweag/jupyenv for this.

your task is very very broad

you mention you don't want to deal with AWS, if it's because of ad-hoc installation concerns and nothing else you can just run your notebooks in ready-made solutions like Google Colab, or Jupyter-book in Github ( https://github.com/executablebooks/jupyter-book ))

that would cover a lot of use cases right away without next to no learning curve

If you don't want to deal with AWS or similar, in that case:

- if it's a static notebook then you can obviously render it and serve the web content (might seem obvious but needs to be considered)

- if it's dynamic but has light hardware requirements, you can try jupyterlite which runs in the browser and should do a pyodine (webassembly CPython kernel) can do: https://jupyterlite.readthedocs.io/en/latest/try/lab/

- otherwise, you can try exposing a dockerised jupyter env ( as in https://github.com/MKAbuMattar/dockerized-jupyter-notebook/b... ) or even better a nixified one ( https://github.com/tweag/jupyenv )

there might be other approaches I'm missing, but I think that's pretty much it that doesn't entail some proprietary solution or an ad-hoc installation as you've been doing

I'm new to Nix and I'm trying to set up a Jupyter notebook environment for Haskell that includes the Hasktorch package. I'm using the jupyenv project from Tweag as the foundation, and I've been able to get it working with some basic Haskell packages. However, I'm running into issues when I try to add Hasktorch to the mix.

i looked at https://nixos.org/manual/nixpkgs/stable/#python https://nix-tutorial.gitlabpages.inria.fr/nix-tutorial/index.html https://github.com/tweag/jupyterWith and i can setup jupyterwith + math-nix + flake to make torch + jupyter

You could look into jupyterWith. With that you can list the packages you want to use in a shell.nix file; based on this file an environment is created in which Jupyter is run. I've also had issues with using packages with regular IHaskell in the past, but jupyterWith works pretty well for me.

(Hopefully the Flakes version of Nix gets released soon, and JupyterWith gets the flake treatment!)

I assume you are getting https://github.com/hasktorch/hasktorch/issues/631? I suspect you need to upgrade to GHC 9.2 to work reliably on M1.

You might find the Deep Learning From The First Principles tutorials by Bogdan Penkovsky an interesting survey of native Haskell implementations of deep neural networks, and a bit more. It demonstrates some native charting capabilities, and Day 9 uses Hasktorch.

I'm new to Nix and I'm trying to set up a Jupyter notebook environment for Haskell that includes the Hasktorch package. I'm using the jupyenv project from Tweag as the foundation, and I've been able to get it working with some basic Haskell packages. However, I'm running into issues when I try to add Hasktorch to the mix.

That said, there are some things that try to do this. Haskell has a port of torch called HaskTorch that includes this kind of typed tensor shapes, and calls the Z3 theorem prover on the backend to solve type inference. It can get away with this because of the LiquidHaskell compiler extension, which has refinement types capable of solving this kind of typing problem, and is already pretty mature. Dex is a research language from Google that's based on Haskell and built to explore this kind of typechecking. Really you'd want to do this in Rust, because that's where the tradeoff of speed and safety for convenience makes the most sense, but rust is just barely on the edge of having a type system capable of this. You have to get really clever with the type system to make it work at all, and there's been no sustained push from any company to develop this into a mature solution. Hopefully something better comes along soon

As rightfully pointed u/gelisam, both Hasktorch and Pytorch are essentially the same things (bindings to existing Torch library). Therefore, it should be generally possible to use existing pretrained models. Here is an example.

I think it's likely that http://hasktorch.org/ is the library you will want to use for AI models, once you feel comfortable with Haskell.

IF (big if) it turns out you do need deep learning then doing it in Hasktorch http://hasktorch.org/ could be a fun learning project. The team making it is super nice and responsive, too

This said, if you want do do deep learning Python is the obvious choice atm, if only for copy-pasting code from examples (however do you know HaskTorch? https://github.com/hasktorch/hasktorch/ )