I don't tend to button shirts that high because I usually wear button up shirts over another shirt. I'll start buttoning the buttons at about nipple height or a little above or below, depending on what I think looks good (keep in mind it's over another shirt, so I'm not showing off much, just shaping the clothes in pleasing ways.)
Were I hypothetically a guy, I would also button the buttons in whatever way made me feel most comfortable. I may button all the way up, or leave the top button undone.
if that's how you want to wear your clothing then go for it, don't listen to those other guys. truth be told maybe they jealous cause they don't got a button shirt? seriously though, I wear shirts to my neck, hoodies, I just like wearing clothing that suits me and what I like, be yourself, be an individual, as long as it isn't hurting anyone go for it