Top 23 Python Tensorflow Projects
Deep Learning for humansLatest mention: Tensorflow .predict on Pandas rows | reddit.com/r/learnpython | 2020-12-22
Then it's maybe a version bug problem, try to update to the latest tensorflow and keras version. It seems to appear in this issue and hasn't been resolved, switch to Pytorch maybe ?
🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.Latest mention: Replicating GPT-2 at Home | news.ycombinator.com | 2021-01-23
For step 3 you need to send the gradients from each GPU somewhere, and then send back either the averaged gradient or the updated model weights. So when the model is large (say, 3GB for GPT 774M!) that's a lot of GPU-GPU communication!
You're right that for the vast majority of ML cases, the models are small enough that the synchronization cost is negligible, though.
I wrote up some benchmarks here:
Clone a voice in 5 seconds to generate arbitrary speech in real-timeLatest mention: Trailer - Upcoming ACTION RPG - Glory Arsenal | reddit.com/r/PS4Dreams | 2021-01-23
you can also https://github.com/CorentinJ/Real-Time-Voice-Cloning use this to create voices with the power of ai
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.Latest mention: Learning webscraping, data analysis, and visualization, where should I start? | reddit.com/r/learnpython | 2021-01-23
data science ipython notebooks
Mask R-CNN for object detection and instance segmentation on Keras and TensorFlowLatest mention: Top 10 Developer Trends, Thu Sep 24 2020 | dev.to | 2020-09-24
matterport / Mask_RCNN
Deezer source separation library including pretrained models.Latest mention: Does anyone know good (free?) software to extract vocals from a song | reddit.com/r/Beatmatch | 2021-01-25
You can use spleeter or SpleeterGUI. One of the best there is and free to use.
Face recognition using TensorflowLatest mention: Facial recognition using cluster | reddit.com/r/RASPBERRY_PI_PROJECTS | 2021-01-15
ML training is practically impossible on micro-controllers. Inferencing on the other hand is quite doable, especially if aided by a [TPU coprocessor](https://coral.ai/products/accelerator/). Supposedly with the TPU you can do some quantization-aware training, but I haven't tried this. I am working on a security system that does facial recognition to recognize me and some friends and considers anyone else as an intruder. How I am doing this is by retraining [Facenet](https://github.com/davidsandberg/facenet) with my facial embeddings. Use something like Haar Cascade in OpenCV to get the bounding box for a face and put it through the model to extract face embeddings. You can then save these embeddings as a sort of databases for the faces you want it to recognize during the inferencing phase. After that you can impose something like a SVM classifier to say who in your face database it is. One thing I will note is that the problem is even easier if you are only concerned with one face - in which case it is technically face identification - not recognition. If that is the case, you only need to do a difference calculation between the embeddings you saved during training and the result output from inferencing. If you do end up using the TPU, you can connect to it over USB from inside a container (I only know how to do this in Docker though) too. Hope this was helpful. I am actually looking to use a k8s cluster eventually too as a sort of smart hub for my security system and other devices so I can handle much more traffic (not sure if this is overkill or not on the pi 4s).
Decensoring Hentai with Deep Neural NetworksLatest mention: Studying | reddit.com/r/animememes | 2021-01-25
Deep learning library featuring a higher-level API for TensorFlow.
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.Latest mention: Top 10 Developer Trends, Sun Oct 18 2020 | dev.to | 2020-10-18
microsoft / nni
Mapping a variable-length sentence to a fixed-length vector using BERT modelLatest mention: Needed 100% to pass a safety quiz, need to wait a week to retake | reddit.com/r/mildlyinfuriating | 2021-01-12
You joke but
🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation toolsLatest mention: [P] 611 text datasets in 467 languages in the new v1.2 release of HuggingFace datasets library | reddit.com/r/MachineLearning | 2021-01-05
There will be 13 more bytthe end of this week, from Microsoft CodeXGlue, I had not the time to fix my PR earlier : https://github.com/huggingface/datasets/pull/997 .
MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.Latest mention: Apple’s New M1 Chip is a Machine Learning Beast | reddit.com/r/apple | 2020-12-25
Yes. But that's missing the point. Almost everything in the space uses a framework other than Core ML. Therefore most people need good development support for PyTorch/Tensorflow etc., not Core ML. The fact that Apple has a tool to import/convert models is nice, but not relevant. Also, there is onnx as an exchange format between the frameworks, and tools like MMdnn and others.
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.Latest mention: I forced a bot to read 4000 Dan Andrews Facebook posts and asked it to write its own. Here's what it came up with. | reddit.com/r/melbourne | 2020-12-25
For Danbot V1 (The one using 4,000 posts and GPT-2), I used Kevinzg's Facebook Scraper to get my source material, and used minimaxir's text generator to write the posts.
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.Latest mention: best-of-python: A ranked list of awesome Python libraries and tools | reddit.com/r/Python | 2021-01-14
Here ya go: https://github.com/ml-tooling/best-of-ml-python/pull/47
Predictive AI layer for existing databases.
Segmentation models with pretrained backbones. Keras and TensorFlow Keras.Latest mention: Any way to speed up inference prepare operations on host (CPU)? | reddit.com/r/tensorflow | 2021-01-18
That is just U-net from this repo, anything aside is slicing images to fit into window and predict call. I measure time of predict() and it is the same as profiler numbers, so definitely my other operations are beyond profiler. C API code is just creating tensors and calling TF_SessionRun plus slice operations with opencv. Can't post code, sorry.
Python package to easily retrain OpenAI's GPT-2 text-generating model on new textsLatest mention: Does GPT-2 Know Your Phone Number? | news.ycombinator.com | 2020-12-25
The GPT-2 weights were released by OpenAI when GPT-2 was released. (https://github.com/openai/gpt-2)
Around that time (since no one else was doing it) I released a wrapper to streamline that code and make it much easier to finetune on your own data. (https://github.com/minimaxir/gpt-2-simple)
Nowadays, the easiest way to interact with GPT-2 is to use the transformers library (https://github.com/huggingface/transformers), of which I've created a much better library for GPT-2 that leverages it. (https://github.com/minimaxir/aitextgen)
High-performance TensorFlow library for quantitative finance.Latest mention: Show HN: A high-performance TensorFlow library for quantitative finance | reddit.com/r/patient_hackernews | 2021-01-19
LingvoLatest mention: Don’t Share That. Yet | news.ycombinator.com | 2021-01-05
Yes, there are really good open source speech to text tools (automatic speech recognition (ASR) is the common name for that).
Kaldi (https://kaldi-asr.org/) is probably the most well known, and supports hybrid NN-HMM and lattice-free MMI models. Kaldi is used by many people both in research and in production.
Lingvo (https://github.com/tensorflow/lingvo) is the open source version of Google speech recognition toolkit, with support mostly for end-to-end models.
ESPNet (https://github.com/espnet/espnet) is good and well known for end-to-end models as well.
RASR (https://github.com/rwth-i6/rasr) + RETURNN (https://github.com/rwth-i6/returnn) are very good as well, both for end-to-end models and hybrid NN-HMM, but they are for non-commercial applications only (or you need a commercial licence) (disclaimer: I work at the university chair which develops these frameworks).
Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.Latest mention: Apple’s New M1 Chip is a Machine Learning Beast | reddit.com/r/apple | 2020-12-25
And did you even know that Apple provides a CoreML conversion toolkit for converting models from PyTorch, TF, SKLearn and Keras to CoreML? You can comfortably train in your preferred tool and then convert the models to CoreML. (https://github.com/apple/coremltools). It currently supports a lot of conversions
An easier way to build neural search in the cloudLatest mention: Thank you Hacktoberfest! | dev.to | 2020-11-09
TF-Agents is a library for Reinforcement Learning in TensorFlowLatest mention: Can somebody give me reinforcement learning code example. | reddit.com/r/MLQuestions | 2021-01-22
What are some of the best open-source Tensorflow projects in Python? This list will help you: