No, it is not a concern. I have had sex-only partners in the past, where I knew that it was just for fun and nothing more (and I kept it that way).
But during the talks I've had with my wife this thing came up... the "what if".. and of course the "how not to"... and I was curious to see how others deal with it.
So good opinions until now... but the more the better.