There is absolutely sexism towards men as well. Sure, it's not the to degree that women suffer, however it's equally as detrimental to our young developing boys.
You're right, I can't even imagine being a Catholic Priest.
Aside from that though, young boys are taught they have to be "strong" and that if you show emotion you are "weak". Not being able to properly express your emotions causes anger issues down the road. This also turns around and plays back into the overall sexism for women as well because women are considered the "emotional ones" instead of it just being a natural human emotion.
I can't imagine what it must be like to be a young boy growing up being told I have to be this strong man or to "just be a man" in general.