Relay Backpropagation

Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networks

We propose a novel method Relay Backpropagation, which encourages the propagation of effective information through the network in training stage.