It is a
very annoying thing, I know that. Used to happen to me LOTS!
My advice is, adjust it when you log on to how you want it, then play for 2 hours+
Playing time helps it stimulate in the memory.
Then, quit the entire game COMPLETELY (not switch character).
