There are always challenges when working with people from different cultures and languages, and it will probably help by realizing it's not easy for them, either. Most people do not try to be racist, but many people will avoid doing something that is hard, when they can do something easy instead. And they may find communicating with you hard, because your English isn't really good yet, and your accent is different from theirs.
There are ways to mitigate this, with time being the thing that will help you the most. Here are some other ways to bridge the communication gap.
Find an ESL (English as a Second Language) or other class or venue where you can practice your language skills outside of work.
Tell them you are trying to communicate better, and ask them for advice to make it easier for them, tell them you will accept corrections, and try hard to avoid being offended by their behavior.
Remember you are there to work, not to be friends. Some work relationships do develop into friendships, but many do not. Perhaps in the culture you are in now, people tend to keep work and their private lives more separate. If so, seek friends outside of work. But always treat co-workers with respect (even if, especially if it seems they are not being respectful to you!)
If you can avoid feeling offended, you'll find that most people are not trying to offend. With time, your English will improve, and they'll become accustomed to your accent, and it will be much easier for them to communicate with you.