What Lovie said - I don't think anyone has said that physical attraction is the only factor, and I really don't grasp the leap from "he complimented me on my smile - he expects me to immediately okay scrabble and is only interested in my looks." It's far more realistic that he simply complimented you on your smile as a way to start a conversation. I think it would be rude to respond negatively to a genuine compliment.
My statement was in response to this comment -
"I'd have no problem with a potential mate complimenting my appearance. In fact, if they didn't, I would wonder if they were attracted to me at all."
and to repeated statements throughout the thread that some are interpreting statements of 'don't jump right in with the physical compliments' and 'don't hit on people who aren't interested in being hit on' as 'don't initiate flirting at all, ever' and 'don't compliment, ever'.