These are my reactions to what you wrote:
He said "Are you mad at me? Because you're usually very nice and last time I came over you seemed annoyed with me." He was very spazzy when he said it...
Yellow flag. Maybe he's being honest and trying to communicate. Maybe he's being manipulative and pushy and trying to get you to overcompensate by being super nice to prove that you're still a nice person.
he told me "Your lights were on and I knocked, but you didn't answer."
Yellow to red flag. Stalker behavior. Pushy to tell you that to try to get you to JADE (justify, argue, defend, explain) to him. Not his business why your lights were on. He could have made the observation in his mind and made a mental note, but he's not your keeper, he has no business "calling you out" for allegedly being home and not answering your door.
To this, I might have replied "Oh, that was the night I was super constipated and was on the toilet for 2 hours. Oh, my poor hemorrhoids" just to not reward his pushy comment and shut him up.
He also told me yesterday that I look tired.
Yellow to red flag. He's either rude and mean and trying to put you down because he's a jerk and he likes to push nice people around. Or he's just socially awkward and clueless. Either way, so far, he's not seeming like the kind of person I'd want to spend tons and tons of time with. I'd cut him loose as an acquaintance. No need to answer the door anymore to anyone who hasn't told you in advance that they're coming over. For a while at least, till he learns to stop.
I know I could take him on if he tried to attack me unarmed...
And if he were armed?
There's no reason to be opening the door for him. You care about
his feelings. More than you care about your own? Ignoring his knocks/rings isn't mean. You're not telling him to go jump off a cliff or have a miserable life. You're just living your own life. If you want to spend your evening on your couch picking lint out of your belly button and have no other reason not to open the door, you still don't need to. You're not responsible for his feelings, or to make sure that he has friends or is socialized or instructed in considerate behavior.
he asked me how I profiled him when we first met...
Another yellow flag. Awkward behavior, IMHO.
I'm a crime buff, I'm a little extra paranoid (which makes me less trusting in general).
My opinion is that you're not paranoid. I've lived in big cities and heard lots of stories. I think everyone should have a peephole or a side window and shouldn't open doors unless they know and fully trust the person on their doorstep. Again, JMHO.