if you find yourself needing to say
 

"I have X friends so i'm not prejudiced against X group" then you probably need to take a second look at what you're saying

Im sorry but all I could think of when reading that is having the X-men as friends.

Kind of like saying "No offense" before saying something offensive to someone :P It doesn't negate that fact that you are saying something offensive to them and you felt compelled to do so.