If you're in the same server as someone, you can click their name and see a list of all the servers you share. So only the people who are also in that other server would know you're in there.
You might want to make sure you turn off the feature that autodetects what game you're playing and puts it as your profile status though
THIS IS WHAT I HATE A BOUT EVREY WEBSITE!! THERES SO MUCH PEOPLE READING AND POSTING STUIPED STUFF