Everyone is different and while this may work for you and your husband it didn't work for myself and my wife. Although, initially, it was a heckuva lot of fun
.
When she went out I was charged with sexual tension (good) and anxiety (bad). We screwed like rabbits when she came back.
Then I went out and had fun with my friend. No problem.
Then she went out and became more emotionally involved than me. It has taken a long time and a very heavy toll on our relationship to get back on track.
My advice is to keep it a fantasy. Stick to swinging together and/or threesomes with hubby present or close by.
Jest my 2 sense. soapbox