There is a club that says its members must wear red dresses and purple hats. But it is rude to tell people how to dress, so the club is rude? No. The members accepted that rule. Since it only affects the club member, it is up to them (except if there is budget concerns over the price of the dress and hat).
There is a club that says everyone must meet in a cafe once a month. If someone can't go to the cafe, then they shouldn't be a member.
A different club organizes outings. If someone can't go to the outings, they shouldn't be a member.
This club asks for an empty house when hosting. If the husband can't offer that, he shouldn't be a member. Simple.
Now, how the husband settles this with his wife is a relationship matter. If he just tells her "get out of the house", he is being rude. If he asks her if she minds leaving for a couple of hours, she can say yes or no. They can make a bargain (she gets a mani-pedi during this time, which her husband pays for from his fun budget). If she agrees and then backs out (without prior warning, like the Bunco husband), then she is being rude.
However, if his wife refuses point blank to leave the house to him for a few hours, then he can't fulfill the requirements to be a member of the club. So sorry.