I can't say this would be a real problem with most swingers.
I'm not talking from any real experience here, but what I have gathered from hanging around on the board a majority of swingers are not all that shallow.
With me it would come down to skills involving how well your hands carress my skin, not how strait your penis is.
If there is a chance that intercourse could be painful for the women, ya let them know so they can decide whats what. If it is not that much of a curve, don't worry about it.
If there is one thing I learned after becoming my own woman it is don't take yourself to seriously, you will miss all the fun.
If someone comments about the curve just say, "if you turn your head like this and squint your eyes just so, it looks like it is smiling at you".
Seriously though, smile and enjoy life
Your friend,
Prettylady