Hidden lair initiation bugg

Im trying to complete exploration and thus trying to find hidden lairs in specific maps that I need. However several times when I finnaly find a party and hidden lair hasnt disappeared on me another person in party is able to initiate hidden lair in another area that im not interested in because im already done with exploration of that area.
An easy fix would be that only party leader that initiated party finder hidden lair can initiate.