This repository contains an experimental PyTorch implementation exploring the NoProp algorithm, presented in the paper "NOPROP: TRAINING NEURAL NETWORKS WITHOUT BACK-PROPAGATION OR FORWARD-PROPAGATION ...

Obviously, building with PyTorch was way simpler. All I needed was to add two linear layers and an softmax activation layer in the middle. With the model from scratch, I used the same architecture but ...