Steps to Reproduce
Create a new launcher project, use the FirstPerson template
Add a Navmesh Bounds Volume and ensure it overlaps some geometry
Press P to toggle navigation on/off in Editor.
Start a Play in Editor session, and press P to observe that Show Navigation is also toggled on/off when in PIE.