Crying infants were taken out temporarily by a parent or caretaker. Everyone else was expected to (and made to) sit, quietly -- doodling or tic-tac-toe were acceptable, as was reading the program/prayerbook/songbook. If you HAD to get up for a bit, a "bathroom break" was an acceptable excuse to stretch your legs or wander for a minute, OUTSIDE the area where the ceremony was taking pace.
I was the eldest, so I can't report on my own behavior, but I do remember my toddler siblings being held to these standards. It was harder at some times than others.
All that said ... it's not up to the audience to offer a "hush!" or give the stink-eye to disruptive people.
My two are two and four. I'd dearly love to know how to 'make' them sit quietly through our 90 minute service. I try, I promise. The four-year-old is pretty good now, but still gets a bit bored and restless. The 2-year-old is oblivious to stink-eye, shushing, and what he desperately wants is to go outside. Even if we did go out and he calmed down, there'd be no coming back in without lots of wailing. Plus the whole, givet him exactly what he wants, thing.
I'm pretty lucky - our pastor comes down hard on the side of, 'We want kids and families here - no-one is to give them stinkeye,shush them or in any was show displeasure at noisy kids.' You'd be considered rude at our church, OP, sorry.
That being said,no-one, including me lets their kids run riot in our church. You just can't make some toddlers sit still for 90 minutes.
I would also remove my kids if they were being disruptive during a special ceremony in our service - baptism, first communion etc. But I do my best to keep them quiet and distracted during regular services, but I don't take them outside during those.
I personally tink church is a very different situation than many other situations. I would never advocate taking a squirmy child to the theatre or a fancy restaurant. Church isn't just a performance, though, that's totally optional. It's the worship service of a religion, and those include the children of that religion and the embarrassed parents trying hard to keep their kids quiet, while missing most of what's being said.
If, while attempting to be a dedicated member of my faith, by doing what feels like running a marathon on a Sunday morning (ie sitting through church with squirmy kids trying to keep them quiet), someone indicated that their hearing every word of the sermon was more important than my best attempts, I'd be pretty upset.