Continual learning

The problem, and solutions thereof, arising from catastrophic forgetting of old tasks upon learning new tasks. See below for a neat finding that this might not be as big a problem as previously feared. Rumours of catastrophic demise may have been greatly exaggerated.