Yes, OP, your excuse for being tired is just not good enough.
If you had children, the message would be, "You obviously don't have YOUNG children."
If you had young children, his message would be, "You obviously don't have teenagers."
If you had teenagers, his message: "You obviously don't have adult children who are just starting out."
I hate one-upmanship.