Every new drop in the memory bucket is proportional to all the memories in the bucket. Each new memory makes up less of the whole, making it seem like time goes faster. It’s a real phenomenon

Edit: The science behind it - Numberphile