If you leave alot of games in Quick Play (like i did, and it tanked my endorsements alot), you cannot be endorsed by other players after the game for that game, because someone else will have taken your place. Theres no code actively removing endorsements. Just that your endorsements-per-game ratio goes down. Thats whats happening.