I am working on 3 separate projects that are linked under my competency's team but are completely separate/independent from that team's major project. I have been a part of the team for almost a year now. My team has over 30 members and they're all working in a same project. I am a single thread resource, meaning I am independent and manage everything myself for the 3 assigned projects. I have complete authority on making decisions, communication with clients and even on my office timings, my manager never steps in unless there's some serious escalations and this actually suits me quite well.
I am sometimes bothered about my social reputation among my team. Since, I never interact with them for project issues/assistance, I still feel like I don't know most of them and don't know what they think about me. I do attend any annual or semi official team dinners/hangouts but there, I am mostly sitting idle, doing my own stuff. They're normally laughing or joking around and I am never a part of it. I feel like they have strong bond. Now, if you ask me, I prefer how things are because since I don't know a bunch of them, I have negative image of a few and always feel like avoiding them.
But this exactly my concern is, if I have negative perceptions about them, they might be thinking the same way about me. Would this affect my reputation in organisation? Would my manager be affected by this? with whom I have an excellent professional relationship.