I have finally found the answer after a bit of digging.
There are 2 ways to do this and first the reference to the controller component
http://api.unrealengine.com/INT/API/Runtime/HeadMountedDisplay/UMotionControllerComponent/index.html
First, if the controller is added into your Character via code which it is in my case, you can also set the bDisplayDeviceModel to true (or call SetShowDeviceModel with true as a parameter). This has to be done in BeginPlay and not in the constructur or UE Editor crashes after it compiles.
Secondly, you can set in the BP Editor just by selecting the check under Visualisation.
There’s a gotcha with the second method where I read you can’t edit them if you set the names to LeftController or RightController, which I had. Also, if adding via C++ you need to set the UPROPERTY.
I guess I’ve answered my own question about the WMR controllers.