On the Geometry of Generalization and Memorization in Deep Neural Networks

Our latest work, presented recently at the 2021 International Conference on Learning Representations (ICLR), forces a deep network to memorize some of the training examples by randomly changing their labels.