I don't get how people don't understand the concept that you can't abuse if you make the rules. Technically I'm following the law because I am the law.
I'm gonna argue with you on this one just because I feel like being petty. First of all you can break the rules even as a server owner if you make a notice entitled "the rules". The fact that someone made the rules does not alone change what is currently written, allowing the written word to be "broken". If you define the rules to be "what I say goes", that is another matter, however.
Nevertheless, the term "abuse" is merely synonymous with and not equivalent to "breaking the rules". Abuse is often defined as an application to a wrong or bad purpose or misuse. What defines "a wrong or bad purpose"? Not rules or laws, as people are often accused of misusing rules, but ethics. Now I hardly expect an agreement on what is "ethical" server adminship since almost every person has their own opinion on the subject, but that is the point. When someone calls out "abuse!", it is to say that one misused (as per the definition) authority
according to their own definition of misuse, which may have no connection with server rules. Does this have any effect on the server owner? I highly doubt it. After all, there is no higher power on a server except a server owner. But ethically speaking, I don't believe might makes right either.