Why do some answers get a thumbs down when they're straightforward, polite and honest?

Is it because the thumbs down giver just didn't agree with my answer? I've never been rude or sarcastic. Just honest and polite. If I don't have something nice to say, I just skip the question.