Camera breaks after switching characters

For some reason whenever I log out and switch characters the camera stops working correctly. Using left click to move the camera won’t snap back to its normal position, instead staying to wherever I moved it at. The only way for me to fix this is just to completely close out of the game and restart it. This is annoying because any time that I want to switch to an alt I have to restart the client.

Any ideas for a fix? I’ve already tried messing with the auto-follow settings but they don’t do anything.