I think meeting in a public place to break up is terrible advice, frankly. If you're afraid of an extreme reaction or violence or something like that, I think it's safest to end the relationship over the phone. Etiquette doesn't matter in cases where you fear for your well-being. If you're not afraid of a bad reaction, then the poor dumpee has to deal with controlling their natural reactions in public or risk making a scene, potentially embarrassing them and making the break-up worse than it had to be.
Since it's been a short relationship, I POD everyone else in that you're fine to do it over the phone. TurtleDove has a good point in letting him decide how to proceed - say something like, "I don't think this relationship is working out, and I'd like to discuss it. Would you like to meet up?"
And, if you do have the talk at your house, don't be afraid to ask the dumpee to leave if you're being subjected to endless discussion, hashing, or begging to be taken back. It sounds cruel or harsh, but honestly, cutting it short is kindest for the dumpee. Say your piece, give them a chance to respond, and then say something like, "There's nothing more to discuss. I'm so sorry for hurting you, but this is final and I don't want to drag it out. Please go."