Set Visbility Performance Issue

So I have a multiple camera setup 1st person and 3rd person, each has their own mesh (same geometry, different instance). I am using set visible which is running off event tick, to turn on and off the mesh depending on the perspective I am in. And set active to swap the cameras. However I have noticed that every time I do the perspective switch. I get a massive drop in fps that stays constant, and my gpu usage drops as well. I have narrowed it down to set visibility as the cause of the drops. It happens whether I have it running off of event tick or an input action. Every time set visibility is ran the fps gets a massive drop and it takes a good 30+ seconds to recover (if it recovers) depending how many times set visibility was ran. Is this because I am using it incorrectly? Or is there another reason for it? I am on 4.1.2.

Here is how it is being used…
Set gameplay camera state is currently running off event tick.

speed bump

Super Bump

So I have actually managed to narrow this down to the Owen mesh itself. It only seems to cause poor performance when using that mesh. I thought maybe it had something to do with the cloth simulation but disabling it made no difference…So I have no idea what it is other then it has something to do with the Owen mesh.