I am looking to create an effect similar to this video:
The effect is achieved by attaching a real camera and a virtual camera to a motion controller. If done correctly, you can easily overlay both videos with any normal video editing application.
Currently my problem is getting a recording from the virtual camera with someone playing the game in VR. I have tried adding a local player, but any kind of local multiplayer with VR seems to not work with the current version of Unreal (there is a post about it here). I also tried recording with Matinee, but it doesn’t seem like the game is playable when Matinee is capturing.
What I am planning to do now is creating a replay (console command: “DemoRec <replay name>”) while recording someone playing the game in VR with the real world camera. Later I will watch the replay with the spectator pawn attached to the motion controller and capture the screen with a tertiary application (AMD’s plays.tv thingy).
Do you have any suggestion, what I could or should do differently?
Or do you have a different workflow for creating mixed reality videos?
Edit 1: Currently I can not get the Replay System working. I am getting the following console output:
Cmd: demorec <test> LogNet: GetLocalNetworkVersion: GEngineNetVersion: 2872498, ProjectName: replaytest, ProjectVersion: 220.127.116.11, InternalProtocolVersion: 9, LocalNetworkVersion: 1044399586 LogDemo:Warning: UDemoNetConnection::ReplayStreamingReady: Failed. LogDemo: StopDemo: Demo <test> stopped at frame 0 LogNet: UNetConnection::Close: Name: DemoNetConnection_0, Driver: DemoNetDriver DemoNetDriver_0, PC: NULL, Owner: NULL, Channels: 0, RemoteAddr: UDemoNetConnection, Time: 2016.03.21-18.46.32 LogDemo:Warning: Demo recording failed: Couldn't open demo file <test> for writing
When I try recording a second time, I get the following output:
Cmd: demorec <name> LogNet: CreateNamedNetDriver DemoNetDriver already exists as DemoNetDriver_0 LogDemo:Warning: RecordReplay: failed to create demo net driver!
Do you know what’s wrong?
Edit 2: The problem was that I only tried recording replays in Play in Editor (PIE) mode. It works when playing in Standalone.
However I probably cannot work on this much for about 1 or 2 weeks. So do not expect an update if I got it working earlier.