Cannot remove watchtower from node

Hello! I am having trouble trying to remove an unused watchtower from my node getting this error every time i try to remove it “Unable to remove watchtower - removing towers is disallowed while a new session negotiation is in progress.”
Does anyone here knows a fix for that?
Cheers

Not too sure, maybe something here on Github can help?