It should not have a massive impact. Can you actually reproduce this behaviour by plugging the monitors back in?