Primary attack aim delay

I’m using sacred fire build with crusader. When using the primary attack aim function to aim ‘the bristle’ there’s a huge delay sometimes up to 2 seconds. It’s a big problem especially during pvp