Eternal realm Gem fragments limitation

i mean, i dont see why not personally… but also… why is this an issue?