I wonder if perhaps this was a case where both couples expected the other couple to "make the first move" and this other couple got frustrated waiting for an opening or for something to happen. One of those cases where expectations ended up ruining the moment.
We tend to not really be sure how to "make the first move" when first playing with a new couple and we're a bit shy to do so. So I definitely empathize with that part. Not sure if that really was a factor here or if you guys were just working at your pace and they didn't get that.
Being more open to making a move is something we need to work on a bit