Swapping specs disables Breakneck's boost

It gets the same red x icon that it does in raid.

and what addons are you using?

I use Bartender4 for my action bars, but turning that off still shows the icon with the X.

Any that are related to talent trees or talent loadouts?