After an upgrade cooldown triggered to remove a signal we also need to
prune it from the list.