It takes some juggling, that's for sure. You, as a parent, need to resolve yourself that you probably won't see your kids every single year the same way. I typically do Christmas Eve with dad, Christmas morning with mom. When married, we did every other year - his family one year (in town, not divorced) my family the following year (out of town and divorced). Then there were the other family members (in town) who are not on speaking terms with other relatives...whew!
This included rotation around all the other holidays, so Thanksgiving in town, Cmas out of town, Easter in town, and the next year it went the other way.
Really it came down to trying to cram all the family into short time frames, and I'm sorry, it's too much and too exhausting, especially with the addition of babies. My siblings and I grew tired of not being able to see each other as well, so we worked very hard on maintaining a rotation schedule with all the perspective families so at least on a rotational basis, we could be together.
One thing I got met with is, "I don't want to spend
my holiday on the road" when the out-of-towners were invited here. Well what makes you think I do?

So, a rotation works for me.
I knew some people who had a standing weekend the weekend prior or the weekend following or something. I can't remember how they did it, but they did Christmas *not* on Christmas as standard routine, so the kids could deal with in-laws on the holiday and do Christmas at their house at a different time and get the group together.
It's a matter of being flexible and hopefully you can establish a rotation that works for your family, which will involve a lot of other people likewise having to bend to a routine, but it's doable. I worry too when my kids are grown and have to deal with divorced parents and the addition of a spouse, in-laws, and grandbabies.