i’m having the same issue. my game doesn’t lag and im using a standard xbox one controller but otherwise my issue is identical. i can’t tell what causes it, it appears completely random. it can happen several times in an hour or several hours can go by without issue. sometimes it seems to be caused by loading a new area, usually it just happens while walking around in the game world. it seems less likely to trigger while in combat but i might just be interpreting patterns that aren’t there.
so far i have tried:
charging the controller
updating the firmware of the controller
updating my bluetooth xbox controller driver (it was already up to date)
(also my batteries are brand new, doubt they have gone weak or whatever)
none have worked.