The problem I see with your proposal is it then becomes meta to farm Challenge Rifts for mats. I don’t think that should be a thing.
I would prefer for a Challenge Rift to be something I can do once and not have to worry about it again than to spend all my time there.