It’s a cap of 4 from the boxes man. You can get more from doing memories. Highly likely that your DK just hasn’t ran as many bountifuls as the rest or that you got a few keys from other sources.
I don’t think content rewards or progression paths should be built to cater toward people that openly dislike the content.