I know what you mean about wanting to fit in. Its not like you really care about going out with them, its just like feeling like the outsider

maybe just with one of them try to strike up a conversation with them......i dunno how you are IRL, but if you are quiet or shy, they might think you don't want to hang out with them. Are you doing anything with your behavior that may come off the wrong way?