And he changed his mind 4 years later, because characters are not static and can change, grow, and are otherwise not bound to things they said years ago under different circumstances.
Just saying “it doesn’t make sense” doesn’t actually make it so. It makes perfect sense that Jim would try and take back something that he lost. Those losses and how they affected him are major parts of his character.