I have to agree with the others who feel that your boyfriend is the problem here.
I have no idea what your relationship is with your boyfriend, but my husband and I have some important rules that we do not break - If one person is not comfortable with a perspective playmate, for whatever reason, the we break off contact with them.
I do not let anyone bad mouth me when I have done nothing wrong, and I do not let some woman try to break me and my husband up. (I don't think I would make a very good submissive

).
I think he needs to start respecting your feelings a bit more.