ml5-library VS pytorch-lightning

Important APIs - ml5 for in-browser detection, face-api that uses tensorflow-node to accelerate on-server detection. VueUse for a bunch of useful component tools like the QR Code generator. Yahoo's Gifshot for creating gif files in-browser etc.

> Have we seen any creator of a deep learning library, take a similar position if not stopping any support for anyone using it for mass surveillance?

ml5.js license:

> This license gives everyone as much permission to work with this software as possible as long as they comply with the ml5.js Code of Conduct [...]

ml5.js code of conduct:

> Do not: [...] Use ml5.js to build tools of mass surveillance and prediction to repress the rights of people

https://github.com/ml5js/ml5-library/blob/main/LICENSE.md

Not sure how enforcable this is but it exists.

See also: https://ml5js.org/

"The library provides access to machine learning algorithms and models in the browser, building on top of TensorFlow.js with no other external dependencies."

(5) ml5.js

ML.js

I used ml5js.org , p5js.org and https://teachablemachine.withgoogle.com to train the Banana images. When you create a new image project on Teachable Machine, you can output the p5js and basically use it right out of the box - I customized js, css, and html from there.

Going forward: I'll be 100% into JavaScript. You can use JavaScript in so many fields nowadays. Websites React, Mobile Apps React Native, Machine Learning TensorFlow & ML5, Desktop Applications Electron, and of course the backend Node as well. It's kind of a no-brainer. Of course, they all have specific languages that are better, but for now, JavaScript is a bit of a catch-all.

Yeah they made ml5.js for this reason: https://ml5js.org/

I do feel like Google could do better communicating all of their different tools though. Their ecosystem is large and pretty confusing - they've got so many projects going on at once that it always seems like everyone gets fed up with them before they take a second pass and make them more friendly to newcomers.

Facebook seems to have taken a much more focused approach as you can see with PyTorch Live

From other comments, a lot of JavaScript developers who want to use TensorFlow had never heard of TensorFlow.js or ml5.js!

https://see.stanford.edu/Course/CS229 https://lightning.ai/ https://www.youtube.com/watch?v=00s9ireCnCw&t=57s https://towardsdatascience.com/

I've been wondering on what is the recommended method of saving logits/activations using PyTorch Lightning. I've looked at Callbacks, Loggers and ModelHooks but none of the use-cases seem to be for this kind of activity (even if I were to create my own custom variants of each utility). The ModelCheckpoint Callback in its utility makes me feel like custom Callbacks would be the way to go but I'm not quite sure. This closed GitHub issue does address my issue to some extent.

Our codebase for the diffusion models builds heavily on OpenAI's ADM codebase , lucidrains, Stable Diffusion, Lightning and Hugging Face. Thanks for open-sourcing!

For lightweight use, pytorch-lightning is too heavy, and its source code will be very difficult for beginners to read, at least for me.

For the A100 GPU, theoretical performance is the same for FP16/BF16 and both rely on the same number of bits, meaning memory should be the same. However since it's quite newly added to PyTorch, performance seems to still be dependent on underlying operators used (pytorch lightning debugging in progress here).