Yes, the guy crossed the line. And yes, I'd be pretty angry at my BF for not telling him so.
No offense, but this is pretty sexist. The OP should have spoken up since she was the one being harassed, and if that didn't work she should have gone to management. While it is is great to have a SO support you, it's important to be able to take action against these sorts of things on your own.
While I understand what you are getting at, I do think what made this situation weird was that he was talking to my boyfriend 100%, not to me. That's the only reason I think he might have listened to him -- though he obviously didn't listen to either of us (and other posters are right that we're both nonconfrontational to a fault).
We chose not to let it get to us because it was so absurd it was easier to ignore one ranting weird man than engage the staff, but I appreciate everyone saying they'd have engaged a professional's assistance.
It is very odd when someone is talking "to" you, except they aren't, and it can be difficult to figure out how to react.
At my former job we had some extra help come in for a few days because we were preparing for a big inspection. One of the extras was a department manager from another store who was friendly with my dept. manager. I'd never met him before but I'm perfectly capable or working with people I've just met. Him, not so much.
For two days it was "Tell her to do this." and "Tell her to set up that." Each time he'd be speaking to my manager but I'd be within earshot. Finally on the third morning I was standing on one side of a display, my manager was on another side of the same display, maybe 3-4 feet away, and this guy was another 3-4 feet beyond my manager, so 6-8 feet from me and easily within hearing and eyesight. He says, to my manager of course, "Tell her to finish that up and then do the other thing." I'd had enough so I said to my manager "Tell him I'm standing right here and he should feel free to speak directly to me!" My manager went

and then

and then said "She's got you there!"
Of course the jerk extra manager never did speak directly to me. Instead he just pretended I didn't exist which suited me just fine as I was free to do my job as usual.