In my previous post (see MLP: Incremental learning), I demonstrated that Incremental learning does not work for MLP. So how can we make MLP learn several functions ? The solution is to mix the entries in the training set. If we create 4000 groups containing 1 entry for the AND operator, then 1 entry for…
Month: June 2021
MLP: Incremental learning
This article is about the capability of the MLP to learn incrementally in the same way as the brain does. The main result of this article is that MLP does not learn incrementally because it forgets what has been learned using the preceding training sets. Incremental Learning When we (as human beings) learn something (for…