Top 19 Python recurrent-neural-network Projects

• handwriting-synthesis

  8 4,115 0.0 Python

  Handwriting Synthesis with RNNs ✏️

Project mention: Handwriting Synthesis with RNNs | news.ycombinator.com | 2023-06-07

• sru

  1 2,098 0.0 Python

  Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• SimpleHTR

  1 1,866 2.3 Python

  Handwritten Text Recognition (HTR) system implemented with TensorFlow.

Project mention: Importing manual handwriten tables in to excel? | /r/excel | 2023-06-24

Have you tried searching GitHub? https://github.com/githubharald/SimpleHTR something like that might help.

• liquid_time_constant_networks

  7 1,258 3.0 Python

  Code Repository for Liquid Time-Constant Networks (LTCs)

Project mention: Liquid AI, a new MIT spinoff, wants to build an new type of AI | news.ycombinator.com | 2024-01-13

• CfC

  7 796 10.0 Python

  Closed-form Continuous-time Neural Networks

Project mention: LNNs - Liquid Neural Networks: Seeking general advice, papers, implementations | /r/datascience | 2023-07-10

And here's the repo: https://github.com/raminmh/CfC

• punctuator2

  3 648 1.8 Python

  A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text

• rwa

  0 601 0.0 Python

  Machine Learning on Sequential Data Using a Recurrent Weighted Average

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• returnn

  4 349 9.8 Python

  The RWTH extensible training framework for universal recurrent neural networks

  

Project mention: Keras Core: Keras for TensorFlow, Jax, and PyTorch | news.ycombinator.com | 2023-07-11

That looks very interesting.

I actually have developed (and am developing) sth very similar, what we call the RETURNN frontend, a new frontend + new backends for our RETURNN framework. The new frontend is supporting very similar Python code to define models as you see in PyTorch or Keras, i.e. a core Tensor class, a base Module class you can derive, a Parameter class, and then a core functional API to perform all the computations. That supports multiple backends, currently mostly TensorFlow (graph-based) and PyTorch, but JAX was something I also planned. Some details here: https://github.com/rwth-i6/returnn/issues/1120

(Note that we went a bit further ahead and made named dimensions a core principle of the framework.)

(Example beam search implementation: https://github.com/rwth-i6/i6_experiments/blob/14b66c4dc74c0...)

One difficulty I found was how design the API in a way that works well both for eager-mode frameworks (PyTorch, TF eager-mode) and graph-based frameworks (TF graph-mode, JAX). That mostly involves everything where there is some state, or sth code which should not just execute in the inner training loop but e.g. for initialization only, or after each epoch, or whatever. So for example:

- Parameter initialization.

- Anything involving buffers, e.g. batch normalization.

- Other custom training loops? Or e.g. an outer loop and an inner loop (e.g. like GAN training)?

- How to implement sth like weight normalization? In PyTorch, the module.param is renamed, and then there is a pre-forward hook, which on-the-fly calculates module.param for each call for forward. So, just following the same logic for both eager-mode and graph-mode?

- How to deal with control flow context, accessing values outside the loop which came from inside, etc. Those things are naturally possible eager-mode, where you would get the most recent value, and where there is no real control flow context.

- Device logic: Have device defined explicitly for each tensor (like PyTorch), or automatically eagerly move tensors to the GPU (like TensorFlow)? Moving from one device to another (or CPU) is automatic or must be explicit?

I see that you have keras_core.callbacks.LambdaCallback which is maybe similar, but can you effectively update the logic of the module in there?

• pomdp-baselines

  5 275 4.3 Python

  Simple (but often Strong) Baselines for POMDPs in PyTorch, ICML 2022

• popgym

  4 143 6.1 Python

  Partially Observable Process Gym

  

• PsychRNN

  1 133 2.6 Python
  

• easyesn

  1 131 2.6 Python

  Python library for Reservoir Computing using Echo State Networks

  

• chicksexer

  1 82 0.0 Python

  A Python package for gender classification.

• DeepMalwareDetector

  1 65 0.0 Python

  A Deep Learning framework that analyses Windows PE files to detect malicious Softwares.

• pyradox

  2 62 0.0 Python

  State of the Art Neural Networks for Deep Learning

• recurrent-fwp

  1 46 0.7 Python

  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)

  

• mdlrnn

  1 17 3.6 Python

  Minimum Description Length Recurrent Neural Networks

• RNN-Twitter-Bot

  1 7 0.0 Python

  🤖✏️ A Twitter bot written in Python trained with a recurrent neural network.

• pytorch-ddpg

  1 0 0.0 Python

  Deep deterministic policy gradient (DDPG) in PyTorch 🚀

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python recurrent-neural-networks related posts

• Liquid AI, a new MIT spinoff, wants to build an new type of AI

  1 project | news.ycombinator.com | 13 Jan 2024

• Code Repository for Liquid Time-Constant Networks (LTCs)

  1 project | news.ycombinator.com | 7 Dec 2023

• Keras Core: Keras for TensorFlow, Jax, and PyTorch

  5 projects | news.ycombinator.com | 11 Jul 2023

• Handwriting Synthesis with RNNs

  1 project | news.ycombinator.com | 7 Jun 2023

• I sent robot forgeries to a handwriting expert

  1 project | /r/StuffMadeHere | 27 May 2023

• Handwritten assignments and in person tests may become the norm again because of AI

  2 projects | /r/Showerthoughts | 4 May 2023

• Best recurrent RL library?

  2 projects | /r/reinforcementlearning | 31 Jan 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 1 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!