It's cheating IMO and cheating is the antithesis to swinging.
This topic is regularly discussed or debated on the boards, especially when a married man poses or admits to being single. There are very nicely written opinions already out there.
This one was a paticular favorite of mine:
My own opinion on cheating husbands