Pitching the tent and staying in one spot, or car camping, means you can go with a bigger tent and luxuries like air mattresses to sleep on.
What you have to consider, though, is what the prevailing weather is like. If it is a windy area, you want to get a tent that isn't too high. I've seen taller tents collapse in storms. Including one I was sleeping in! If you are camping in a spot that gets a lot of rain, you want a fly that will go all the way down to the ground and not just be like a little hat on the top of the tent. But if you are camping in an area that is really dry and hot, you'll want a tent that has screen on the top so you can leave the fly right off and get some good air flow. And if you are camping when it is cold, the smaller the tent, the warmer you'll be. You do need to leave a window or air vent slightly unzipped, though, or it is even colder. Too much humidity from exhaling, I think.
My current tent is just a 3 man. It is made by Roots, here in Canada. It has an extra large fly that gives you an anteroom where you can store stuff in Rubbermaid bins, instead of having it right in the tent with you. I have seen a larger version of my same tent that is supposed to be a 6 man plus the anteroom. It would be comfortable for 3 to 4 people, I would think. And this tent would be high enough that you could put a little table and chairs in the anteroom.
For a bombproof tent, you can't beat the hexagonal Eureka's. Mine is quite old but it is considered a true 3 season tent. You are still reasonably warm, even when it is below freezing. Their 4 season version has been used on Everest.
I have owned Coleman tents. I found them very easy to set up but I find that they aren't fantastic quality. If you are going to be taking it up and down several times over the course of a season, I'd spend a bit more money for a better quality tent. My Roots one seems to be better quality.