I'm 26 and my hubby is 28, you are right, there are not many swingers in their 20's. We have found more of an older croud as well. That may be a good thing, really.
Because we are so new, I think it would be better to start out with others who have worked past all the "newbie" kinks.