Wanting and doing are different things. If your wife called an end to it, and you've stopped pursuing, then you've done all you can at this exact moment. I know how exciting it is when getting started and how thrilling the whole "chase" can be. You don't want it to end, and you especially don't want it to end without fulfillment of some kind. You are more than entitled to those feelings.
Give your wife a good chunk of time. She may come to you one day and go "Oh honey - I had this crazy dream about swinging..." and your window opens up again. Don't stop thinking about it. It's a great fantasy...but for now, that's just what it has to be.