He sounds clueless at best and possibly worse. Just not calling seems rude, and opens the door for more communication, so I'd go with Surianne's wording or yours and just make a clean break of it.
Nothing you posted suggests a reason to date him, is there something else that makes him interesting to you?