A sexless marriage can be very tough on husbands. Not only does it make them feel sexually frustrated, but it can also lead to feelings of rejection, loneliness, and even depression.