OP, I like your 11 am wedding followed by lunch, and I don't care if it is on Friday. As I examine my list of friends and family, it just is not that high a percentage of people who work "normal" M-F hours and would ALSO have difficulty getting that day or midday off. The Prof might, if he had a class scheduled, but he could make part of the event. I might, if I were out of town, and lacked sufficient notice, due to logistics. My sibs and his, and all the cousins, could juggle, except those teaching scheduled classes, barring special circumstances (lawyer in trial, surgeon with operating schedule, and like that.) Yet, except for some retired people and a couple of SAHPs, pretty much everyone we know works, and not all at upper-level jobs or businesses they own. Many, perhaps the majority of people, have a lot of flexibility. If they don't, well, they can decline. Nothing is going to suit everybody. Many people work on Saturdays, anyway. A morning wedding and a lunch sounds delightful.
It was fairly common to do a weekday morning wedding and brunch or lunch when I was young because the couple did actually leave on their honeymoon from the reception, and it was uncommon for people to live together before the wedding. They wanted their wedding night to be at their honeymoon destination.
Go for it. Enjoy. Happy wedding, happy marriage.