We make judgments every day. I'm not afraid of being honest about it. You've obviously made a judgment about people who judge sexual fidelity. Welcome to the ranks.
Honesty is hardly difficult to defend or propagate.
It is fine to be closeted, but it is not to be desired.
But, when talking about being closeted AND deceiving a wife, I have no misgiving whatsoever in judging that. To be sure, they don't have to answer to me or my standards, but I don't have to concur that everything is equal in human sexuality either.
It is wrong to deceive a loved one for selfish gain. It is wrong.