Nav button moving unhelpfully

The nav button for quest objectives keeps bouncing spots from the middle of the screen (helpful) to right underneath the ultimate move button (very unhelpful) and I keep accidentally triggering my ultimate move when I’m just trying to navigate to the next quest objective. Please fix.