I think it's okay to not invite toddlers and babies, and still invite other (older) children. Toddlers and babies have a way of disrupting ceremonies. As long as this standard is applied to ALL toddlers and babies, and not just some of them, then I think it's perfectly fine to exclude that age group.