Credit assignment
Backpropagation remains the gold standard, but alternative approaches that don't approximate it have been recently gaining some steam.
- Autodiff implementations in deep learning libraries - basically the chain rule
- Biologically plausible implementations
1. Multiplexing
1. Burst-multiplexing
2. Dendritic backprop (spatial multiplexing)
2. Feedback alignment
3. Target propagation
4. Relaxation methods - two phases
1. Predictive coding
2. Equilibrium propagation
3. Prospective configuration
5. Least-control principle (using the dual loss function) - single phase
1. Feedback control
2. Disinhibitory control
Links