My workplace is relatively small and quite friendly, but there are a few people who seem obsessed with what everyone else is eating. I do find it odd. Fortunately, no one has ever said anything really negative, such as the OP experienced. In the interests of workplace harmony, I would simply keep a slightly pleasant expression and say, "Good thing it's my lunch and not yours!" in a slightly pleasant tone, and leave the room ASAP.