What I mean by "forget" is more about losing fluency. Right now when I look at a clock, I can have the hour in around half of a second and the minute in another half a second. But I know that a) I was faster a few years ago and that b) this trend for me will likely not reverse.