Everybody have said it, and of course the answer is no no, both enjoy it or nothing else happens, of course don't start anything, because it would make the other couple feel bad about it. I think you must be honest and tell them what happens, or if you're too shy, you may do a discrete exit and look for a better couple.
Take care