Increase its cost. 3 is too low for the buff it gives to all pirates in the board.
A strategy that works really well for me is to kill all the other pirates before they play the Captain, then it’s really easy to kill that card and you win.
I don’t know if you are truly serious, but I have never seen anyone bothered by this card before.