I usually only down-vote if I think a comment is offensive or maybe offensive to someone. I'm OK with jokes and all but sometimes if I think a joke is crossing the line I will dislike or if it is just straight out discriminatory to some marginalized (or not) group.