I've actually done what ImHeretoHelp is suggesting on other servers, both as the 'vigilante mod' and the one allowing it to occur. It legitimately works if you pick the right person, they just need to be an outsider of the whole 'clique', since it will let them do exactly what needs to be done with a minimal amount of bias. Hell I'd be up for doing it myself on here.