What I see as the misuse of the phrase lately has had me wanting that "ignore" feature that we were promised/threatened with!
When it pops out at me is when someone uses it in place of "I don't agree with your assumption".
The use of the "royal we" might not have been ideal, but I agree with the sentiment. It's a phrase meant to shut someone down by pointing out that their assumption could be and very likely is wrong. It's meant to be a conversation killer. That isn't appropriate here.
And I too remember a conversation about this before where many people stated that they agreed that it should be avoided, so it's not as if the person pulled the comment from a deep dark mysterious place.