Homecave giving debuff

There’s been a few times where I have been in the Homecave looking at skills. And came out and had the debuff. Even though I hadn’t event been in the zone for more that 1 minute.

Staying inside Homecave for too long will give you the debuff. Unsure if this is based on time.. or when you go to exit the Homecave, and cancel to stay inside.

Shouldn’t be getting debuff unless I’m outside the Homecave for the specified period.