SetViewTargetWithBlend not getting pawn position unless possess is called

This is an RTS style game where the Player can command multiple units. So the player controller only possessing one pawn doesn’t suffice. I have a pawn camera that I have set as the view target so I can do edge scrolling camera movement. The pawn position gets updated fine when a pawn camera component is used, stops working when I use this camera pawn I’ve made as the view target.