Why refuse to watch an anime due to its fanbase?

[Claraviolet]

I am sure some people wouldn't want to watch anime because of it's fanbase.
So, if you are one of them, could you please let us know, why that's the case?