For LEAVING not for being kicked.
Whatever bug you ran into is just that: a bug. There are multiple examples over the expansions of people getting kicked during the last boss and getting the debuff.
This change was ONLY for leaving. Right here, in print: