Please, for your children's sake, no more play dates with this family at all.
Growing up there was one family that I dreaded. The wife and my Mother were friends before they married and had children and remained friends. Fortunately, we didn't live close, because the oldest child in this family was a mean bully. They would come visit us and he would push and shove, break toys, etc, and we were supposed to entertain him because he was a guest.
When we'd visit their home, he wouldn't let us touch any of his toys, he would still push and shove, and we'd be bored stiff. But it was "fine" because he was just being a boy and "boys will be boys"
My sister and I were quiet, well-behaved (mostly

) children, so we put up with it for a long time. When my younger brother was old enough to protest, my Mother finally realized that this wasn't a good experience for us. So she started socializing with them as only adult get togethers.
I still have bad memories of being around this child. So, until you have seen any signs that the Parents of these children have started enforcing manners and good behaviors, please don't expose your children.
(as an aside, the bully child is now in prison)