Your memory encoder/decoder manager the hippocampus must be working otherwise you would not be able to be learn.

I reckon that these memories are pruned by not being recalled strengthening the neurons making it up because they are not as important and take up bandwidth for the more important stuff like surviving as an infant in a physical world filled with your care takers.