The vast majority of voters don't are not highly informed and just have vibes. My uninformed vibe is that he's pretty good at this job. Would I like someone as charismatic as Obama? Sure. But competency is more important and despite his age, he seems very competent.
At first I agreed with the general "whatever" sentiment. It has some important implications, however.
It discourages people from voting if they're concerned about other people seeing their activity. This could result in a lower quality of scoring for posts.