It really depends on the person. For me, nine in the morning is waaaay too early and I will not be picking up a call from someone I know at that time regardless of whether I'm up or not, unless we've talked about it beforehand and I therefore know they'd only call because of an emergency.
If it's something "official", as in not a social call, I'll be annoyed by the time but definitely not show it. I accept that a doctor/business/government person is probably going to be making their round of calls before noon.
Luckily I don't know anyone who calls me in the morning
if I did I'd have to ask them to stop, to be honest. Politely of course. But unless there's an emergency I really don't want to talk to anyone other than my partner in the morning.
As for me, I mostly just don't make social calls unless it's afternoon. My cut off in the evening depends on who I'm calling/my knowledge of their preferences. If I don't know their preference, then I'll likely not call them after 19:00-ish in the evening.
Edit: all of this also works pretty well because I'm more of a text/private message/skype chat person. I don't phone people just to have a social "how's it going?" chat and I don't like when people call me for that either, because I'm just not a talk-on-the-phone person.