I care about graphics when we're talking about the style of the art.
For example, VVVVVV puts me off with its overly simplistic visuals. I'm not a huge fan of crazy-hard platformers in the first place, but given a choice between that and, say, Super Meat Boy, I'd pick the one that at least doesn't give me an eye-strain headache.