Male privilege is not just the privilege of people treating you nicely or not following you in the street. Even if we assume every trans man passes perfectly and no one knows they are trans they still don't have most of the privileges that a cis man has.
Trans men don't have the privilege of
Being able to travel to different countries
Being able to get daily healthcare
Not being assaulted in prision
Not being institutionalized in mental health facilities
Having clothes, car seats, ect designed for our bodies
Being able to play professional sports
Using the bathroom without worry
Showing people our baby photos
Being able to talk to extended family
Not being disowned
Getting trans specific health care (hysterectomys, top surgery, phallo/meta) easily or at all
Posting photos online and having people internet stalk us to find out our dead name and pre transition photos
Being able to buy binders
Being raped and forced to carry a pregnancy to term due to abortion bans and abusive partners
Getting and keeping full time employment
I would have had way more privilege as a cis (white) woman than I do now as a (white) trans man. Sure sometimes trans men have situational privileges the examples I experience the most is not getting catcalled (unless they clock me) or being taken more seriously in college classes then cis women (unless the prof clocks me) but in exchange for that I am at constant risk of being put into a fucking concentration camp and killed by the us government because we live in a fascist country and I'm a tr@#ny communist.