I just noticed, that when I’m using the mouse wheel to scroll in the Options Window, my Skills are changing too.
(Now I have to remember to check my Skills after changing Options. 
)
Update
This behavior is only on the Video, Audio and Gameplay Tabs. If I am on the Controls Tab, my Skills do not change when scrolling with the mouse wheel.