Keep in mind that genital herpes outbreaks tend to become less frequent and milder as time goes on, so it's easy to not know when it's happening if you've never been diagnosed. Anecdotally, many people who know they have herpes are very good at recognizing an outbreak, even mild ones. There are many people who have never given herpes to their spouse, even over many years. On the other hand, herpes viruses can be shed between outbreaks and no one would know it was happening.
These things all sound really scary, but in fact having herpes is a fairly benign condition. The vast majority of people live with it every day without any major health consequences. There are far more people who are greatly inconvenienced (and made ill) by diabetes, rosacea, psoriasis, and other illnesses. But since none of these is contracted through sex, it doesn't freak people out as much.