OP, I seem to recall from another thread that you have a DH and a baby, or maybe are expecting...? I could be mixed up. But if not, do you go to visit your Bro and SIL alone, or with DH (and baby) as well?
I ask because I would see a difference between your whole family coming to visit my whole family, and you alone coming to visit--for the latter I might think you were mainly interested in seeing your Bro and perhaps the nieces/nephews (if they exist), but I wouldn't think you were specifically looking to spend time with me. Whereas if it's your whole family, I would expect to have a get-together with my whole family at least once, like a backyard BBQ or something, and I would make time for that (if given enough notice).