Actually, clocks can have real issues that cause skips. My old wall clock would jump ahead when the mechanism got stuck. Writing down the jumps might prove it's a hardware problem, not just your mind. Have you checked if the clock needs new batteries or a fix?
Honestly, this seems like overthinking it. You're probably just glancing away and missing the actual time change. CLOCKS don't randomly skip minutes, that's not how they work. Writing it down might actually make you more anxious about time. I've had moments like that too, and it's usually when I'm tired or distracted. Just trust the clock and focus on something else, it's not worth the stress.
I read a psychology study last year where tired people kept thinking clocks jumped forward. Their brains were basically filling in gaps because of low focus. Makes sense if you're stressed or sleep deprived.