I’m so sorry you’re going through this. I think you should talk to him, you’re not getting in his face. You are allowed to talk to him about how you feel especially if he’s saying something to you that you really don’t like and either makes you feel uncomfortable or hurts you. I think you just need to tell him how it makes you feel and just talk to him. He’s your brother, he should understand. Just do it calmly and respectfully.