tensorflow VS Keras

To get up to speed with TensorFlow, check their quickstart Support TensorFlow on GitHub ⭐

Explore here.

Part of the major userbase pull in GitHub revolves around hosting a considerable number of popular projects including Angular, React, Kubernetes, cpython, Ruby, tensorflow, and well even the software that powers this site Forem.

Right but that's not an inherent GPU determinism issue. It's a software issue.

https://github.com/tensorflow/tensorflow/issues/3103#issueco... is correct that it's not necessary, it's a choice.

Your line of reasoning appears to be "GPUs are inherently non-deterministic don't be quick to judge someone's code" which as far as I can tell is dead wrong.

Admittedly there are some cases and instructions that may result in non-determinism but they are inherently necessary. The author should thinking carefully before introducing non-determinism. There are many scenarios where it is irrelevant, but ultimately the issue we are discussing here isn't the GPU's fault.

and things like y = layers.ELU()(y) work as expected. I wanted to see a list of the available layers so I went to the Tensorflow GitHub repository and to the keras directory. There's a warning in that directory that says:

You can use Tensorflow's deep learning API for this.

This is indeed the bread-and-butter, but there is use of all sorts of standard linear algebra algorithms. You can check various xla-related (accelerated linear algebra) folders in tensorflow or torch folders in pytorch to see the list of what is used [1],[2]

[1] https://github.com/tensorflow/tensorflow/tree/8d9b35f442045b...

[2] https://github.com/pytorch/pytorch/blob/6e3e3dd477e0fb9768ee...

2. TensorFlow Developed by the Google Brain team, TensorFlow is a powerful open-source machine learning framework that’s perfect for deep learning and neural network projects. With TensorFlow, you can build and train complex models using an intuitive and flexible API, making it an essential tool for any data scientist looking to delve into deep learning.

I found the official Tensorflow V1 code from a Github branch here (https://github.com/tensorflow/tensorflow/blob/r0.7/tensorflow/models/rnn/ptb/ptb_word_lm.py). All code necessary to run that file is in the /ptb folder (except data).

All breaking changes are listed here: https://github.com/keras-team/keras/issues/18467

You can use this migration guide to identify and fix each of these issues (and further, making your code run on JAX or PyTorch): https://keras.io/guides/migrating_to_keras_3/

I'm guessing the "real" keras code is coming from the keras repository. Is that a correct assumption? How does that version of Keras get there? If I wanted to write my own activation layer next to ELU, where exactly would I do that?

Other popular machine learning tools include PyTorch, Keras, and Scikit-learn. PyTorch is an open-source machine learning library developed by Facebook that is known for its ease of use and flexibility. Keras is a high-level neural networks API that is written in Python and is known for its simplicity. Scikit-learn is a machine learning library for Python that is used for data analysis and data mining tasks.

Click to Learn more...

Keras documentation: https://keras.io/

3. Keras Keras is a high-level neural networks API written in Python that’s built on top of TensorFlow. It’s designed to enable fast experimentation with deep learning, allowing you to build and train models with just a few lines of code. If you’re new to deep learning or just want a more user-friendly interface, Keras is the way to go.

Pandas comes with many complex tabular data operations. And, since it exists in a Python environment, it can be coupled with lots of other powerful libraries, such as Requests (for connecting to other APIs), Matplotlib (for plotting data), Keras (for training machine learning models), and many more.

Our trick is to support GitHub Codespaces, which provides a web-based Visual Studio Code IDE. The best thing is you can specify a Dockerfile with all the required dependency software installed. With one click on the repo’s webpage, your contributors are ready to code. Here is our setup for your reference.

If you’re looking for further resources on running TensorFlow and Keras on a newer MacBook, I recommend checking out this YouTube video: How to Install Keras GPU for Mac M1/M2 with Conda

The thing that pops right into my mind is the following issue: https://github.com/keras-team/keras/issues/13118 People are still reporting memory leaks when calling model.predict and I wouldn't be surprised if model.fit also leaked when called multiple times. Maybe this is a good starting point for your investigation. If this is unrelated, I'm sorry in forward.