You stand infront of the door, log out, log back in and the door is opened for a second or two and you can run straight in with no key. You can also skip the next 2 doors, which are unlocked by clearing the rooms, and clearing the Pyroguard Emberseer boss.
This sucks honestly.