I want to be proud, but...

I'm one of those guys who wants to be super proud of being trans and very open about it esp since I dont pass 50% of the time but at the same time, I'm scared of the responses I get like how "I'm not a real man" "you're fake" "you can't be a man if you dont have the right chromosomes/a penis!" they make me ashamed of myself