When one of the couple have finished I think the intensity falls down and you straight feel it, this is a fact. On the other hand it depends on the affinity you have with the other couple, the more you know them the less the situation will be awkward.
I like when it is over that my wife comes back to me.