Recursions-Are-All-You-Need

A recursive framework to enhance the efficiency of deep unfolding networks. (by Rawwad-Alhejaili)

Recursions-Are-All-You-Need Alternatives

Similar projects and alternatives to Recursions-Are-All-You-Need based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Recursions-Are-All-You-Need alternative or higher similarity.

Recursions-Are-All-You-Need reviews and mentions

Posts with mentions or reviews of Recursions-Are-All-You-Need. We have used some of these posts to build our list of alternatives and similar projects.
  • Recursions Are All You Need: Towards Efficient Deep Unfolding Networks
    1 project | /r/BotNewsPreprints | 10 May 2023
    The use of deep unfolding networks in compressive sensing (CS) has seen wide success as they provide both simplicity and interpretability. However, since most deep unfolding networks are iterative, this incurs significant redundancies in the network. In this work, we propose a novel recursion-based framework to enhance the efficiency of deep unfolding models. First, recursions are used to effectively eliminate the redundancies in deep unfolding networks. Secondly, we randomize the number of recursions during training to decrease the overall training time. Finally, to effectively utilize the power of recursions, we introduce a learnable unit to modulate the features of the model based on both the total number of iterations and the current iteration index. To evaluate the proposed framework, we apply it to both ISTA-Net+ and COAST. Extensive testing shows that our proposed framework allows the network to cut down as much as 75% of its learnable parameters while mostly maintaining its performance, and at the same time, it cuts around 21% and 42% from the training time for ISTA-Net+ and COAST respectively. Moreover, when presented with a limited training dataset, the recursive models match or even outperform their respective non-recursive baseline. Codes and pretrained models are available at https://github.com/Rawwad-Alhejaili/Recursions-Are-All-You-Need .

Stats

Basic Recursions-Are-All-You-Need repo stats
1
3
2.9
30 days ago

Rawwad-Alhejaili/Recursions-Are-All-You-Need is an open source project licensed under GNU General Public License v3.0 only which is an OSI approved license.

The primary programming language of Recursions-Are-All-You-Need is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com