Is there a way to change the hotkeys for all units at once

… instead of one at a time?

It’d be very annoying to have to select every unit and change their hotkeys one at a time.

Unfortunately not really, you have to go through each units screen in the Hotkeys menu.