I am going to cut the Gordian Knot here and say that people are hesitant about you joining because they think your character is really lame.
--
"As the size of an explosion increases, the number of social situations it is incapable of solving approaches zero." -Vaarsuvius, Order of the Stick