To anyone who may stumble across this like I did, the solution to hide everything including the little arrow, is:
Hit the settings button and click “hide viewport UI” at the bottom of this menu, hope this helps someone out there
(The image appears to be cropped, click the image to see the full menu, it’s at the bottom)
Cheers!