Yes, just get the hammer.
I've tried it, it works and that's what my neighbor always did. For some time, he was kinda known for owning two of the PvP KQs he'd always join (the first two ones, the 3x/4x one and the 5x/6x one I think?) as a cleric. He rarely misses the hammer, and whenever he's unfortunate enough for that to happen he just goes defense and teams up with others or something.
