Yeah, if you've got a risk-big party and have to stone while spamming skills every minute, it's going to get annoying and it's going to cost money.
Empowering on SP Usage will actually save you a lot of stones in the long run. And who knows, you might need that silver for something in the future.