We used to play with a couple that had an open marriage. She had many boyfriends, and all those guys were in the position you're in. So it does happen. I imagine it's like the proverbial needle and haystack in terms of odds though.
Would never work for us but the great thing about life is you get to live, for the most part, by your own rules.