Naah, that seems silly. If someone serves me a baked potato, or plain peas, I'm always going to pepper them, no matter how good the chef is. Now, if it's mixed vegetables in a marinade, of course I'll try a bite first, but a plain baked potato is a plain baked potato.
And if someone judges me, in a business or personal setting, for putting pepper on my potato, then that's on them, honestly.
Rob