It shouldn't matter from whom you get the neg rep. As long as we are talking about valid neg reps and not commentless or stupid ones. Valid ones are kind of statistical: Some things irritate people, not the same people everytime, but a portion of people in a population. If you want to better yourself (or avoid neg rep), it doesn't matter if you know who those individuals are. It's enough to know the likes of them are there, and they don't like certain types of posts.