IsNetRelevantFor() taking long time to update

Im using IsNetRelevantFor() to handle a fog-of-war style system, so players dont have access to actor info if they arent in vision. The issue is that actors will only become relevant after several seconds of me setting them to relevant, but i need it to be more responsive, 1-1.5 seconds ideally. Where do i change how long this takes?