Headworx

There is a very insightful podcast episode - the interview of Andrej Karpathy by Dwarkesh Patel . At 00:53:39 they mention for about 1 second the 2021 paper by Erik Hoel:  The overfitted brain: Dreams evolved to assist generalization . It is all just a hypothesis, but I must say I've fallen in love with this hypothesis. Not much proof exists yet, but Hoel is really on to something. Dreams are all undiscovered yet. Impossible to get into. Brain activity scans of course can do nothing, as it is like trying to figure out the logic of the software by scanning activity of the microprocessor transistors. Impossible. But surprisingly the recent advancements in AI may get us to better understand how brain works as we try to rebuild an intelligent system in silicon deep neural networks (DNNs). Erik puts forward the overfitted brain hypothesis (OBH): Notably, one of the most ubiquitous challenges DNNs face is a trade-off between generalization and memorization, wherein as they learn to ...