I don't know the whole story, but I have played with n00b a good deal, and he wouldn't give out such a high compliment as accusing you of hacking, and mean it. Obviously he was only teasing, but on the other hand, I have seen his days where all he does is play the insult game, and that would deserve a kick.
I guess my opinion is that the server ops choose the admin, and they are to enforce the rules. If you don't like the people that run a server, then it probably isn't the best choice for you to play there, because everyone's just trying to have fun, and you can't have fun when you are harassing/being harassed.
Bottom Line: Anyone that makes the game unenjoyable should be removed from the game.