NVIDIA GameWorks Integration

[anonymous_user_52a14607]

Particles aren’t captured in the voxel structure thus do not contribute to the emissive vxgi. I guess their materials must be dealt with differently in the code.

[anonymous_user_52a14607]

@.;225394

I don’t think there’s a console command, but I believe the initialization is lurking somewhere. I’ll look into it.

I found vxgimapsize = 128 in BaseEngine.ini

I can half to 64 to get significantly better performance (saves 7ms on my gtx780), but if I want to lower any more than that it crashes with error:

For selected VoxelizationParameters.mapSize (32), mipLevels (5) must be within range [0, 4]

Where do I adjust the mipLevels? I tried to adjust vxgistacklevel but still get the same error.

I reckon even vxgimapsize = 16 would provide decent enough quality for diffuse. With specular, there should be the option of turning on SSR at the same time as vxgi specular because they both can contribute to the scene (i.e. SSRs for contact reflections and VXGI specular for the hidden information) or have a choice between the two per material.

[anonymous_user_52a14607]

I figured out how to turn on SSRs with vxgi specular. In ReflectionEnvironmentShaders.usf:

#if APPLY_VXGI
		SpecularLighting.rgb += ScreenSpaceData.VxgiSpecular.rgb;
#endif

All I had to do was add the plus sign.

Now the next thing to do is to figure out how to get point light shadows and particles voxelized. Hopefully gameworks can incorporate unlimited bounces or at least provide some way of reading the voxel textures.

[Nudlegaru]

@melak47;226494

Well I think the reason is that is what I would call a “0+1 bounce” approach:
The voxel data structure that holds the lighting information contains only samples from directly lit or emissive surfaces (0 bounces),
and the 1 bounce is achieved by the cone tracing into the voxel structure when shading surfaces - which gives us one very nice diffuse bounce.

But for reflections, means that reflective surfaces are only able to reflect that 0-bounce lighting stored in the voxel structure.

For reflections to be able to reflect the 1 diffuse bounce, reflective surfaces would either need to perform 2 bounces themselves
(first, trace a number of cones to surfaces that surface “sees”,
then trace from those surfaces into the scene to determine their illumination so we can reflect them),
or like someone else said, the 1 bounce diffuse illumination calculated for the scene would have to be added to the voxel structure after diffuse shading, and the specular shading performed afterwards - that way it could “see” and reflect diffuse bounce.

The first option sounds expensive, duplicating a lot of cone tracing that was already done for the diffuse shading for the reflections.
As for the second option, separating diffuse and specular shading into different passes is probably going to be expensive as well…

Well, I hope you guys can come up with something

In the museum demo : https://developer.nvidia/gi-works indirect specular works fine.

@;226862

I figured out how to turn on SSRs with vxgi specular. In ReflectionEnvironmentShaders.usf:

#if APPLY_VXGI
		SpecularLighting.rgb += ScreenSpaceData.VxgiSpecular.rgb;
#endif

All I had to do was add the plus sign.

Now the next thing to do is to figure out how to get point light shadows and particles voxelized. Hopefully gameworks can incorporate unlimited bounces or at least provide some way of reading the voxel textures.

What is the use of VXGI if you need to enable SSR? I thought VXGI could do indirect specular by its own.

[Mike.Skolones]

@;226743

By the way. I can use commercially right?

Yes, of course! Please do!

The UE4 EULA specifies that anything we share can be used by any UE4 licensee.

Thanks,

[Ad3ViLl]

VXGI Cave

Hey Guys

Just took some screens of the Cave with VXGI enabled. I think it looks amazing. Pretty brutal on my PC though. Frame rate went from 86fps to 9fps and thats on a GTX970. But that’s ALL the point lights enabled for VXGI and ALL materials enabled.

The first image is without VXGI on and the second with it enabled.

[Nudlegaru]

@ , indeed better lighting ! Great work

Can you please post pics of the the voxelized opacities of the same scenes using r.VXGI.DebugMode 2 command to see how the voxels are behaving?

[Ad3ViLl]

@;226932

@ , indeed better lighting ! Great work

Can you please post pics of the the voxelized opacities of the same scenes using r.VXGI.DebugMode 2 command to see how the voxels are behaving?

Sure, they are. In the same order as above.

[Gandosh]

@.;226898

Yes, of course! Please do!

The UE4 EULA specifies that anything we share can be used by any UE4 licensee.

Thanks,

Thank you!. One last question. Is there anyway to get all of gameworks stuff in one engine? Wave works + VXGI + Flex in one engine.

[anonymous_user_0df12f74]

@;226964

Thank you!. One last question. Is there anyway to get all of gameworks stuff in one engine? Wave works + VXGI + Flex in one engine.

is the answer gave a few pages back. They will be creating an All-in-one version once a couple more parts are integrated.

@.;217692

You should be able to merge the branches into a single branch (for example, called ‘AllFeatures’). You would do:

• *git checkout release *(switch to standard 4.6.1 release branch)
• *git branch AllFeatures *(make a new branch from it)
• *git checkout AllFeatures *(switch to the new branch)
• *git merge Flex *(merge all the changes from the Flex branch, which should work fine because the FleX branch started out as the release branch)
• compile the AllFeatures branch to make sure the merge worked OK.
• *git merge WaveWorks *(merge all the changes from the WaveWorks branch, the WaveWorks branch also started out as the release branch)

Then you would try to compile the combined branch. is what I intend to do when we get the VXGI, HairWorks, TurfEffects, etc., up and running.

[Mike.Skolones]

@;226966

is the answer gave a few pages back. They will be creating an All-in-one version once a couple more parts are integrated.

I forgot one critical step. Let’s assume you did a

git clone /NvPhysX/UnrealEngine.git

From that you are getting only the default branch. Now you must do:

git branch VXGI origin/VXGI

also
git branch FLEX origin/FLEX

git branch WaveWorks origin/WaveWorks

Then you are ready to make a new branch from release and merge the others to it.

[melak47]

@;226876

In the museum demo : https://developer.nvidia/gi-works indirect specular works fine.

Are you sure?

https://dl.dropboxusercontent/u/247271563/museum.jpg

I don’t see any of the indirect lighting on the arches around the screens being reflected by the floor, only the screens themselves, which are emissive no doubt.

[Nudlegaru]

@melak47;226990

Are you sure?

https://dl.dropboxusercontent/u/247271563/museum.jpg

I don’t see any of the indirect lighting on the arches around the screens being reflected by the floor, only the screens themselves, which are emissive no doubt.

Oh I didn’t notice that, I just saw that and heard him talking about it in that video. It seems not all elements get indirect specular then. Maybe such things need more than one bounce.

[Mike.Skolones]

@;227003

Oh I didn’t notice that, I just saw that and heard him talking about it in that video. It seems not all elements get indirect specular then. Maybe such things need more than one bounce.

Hmm, Dunno. If the light on the arches is indirect, the light has to bounce off of something, then off the arches, then off the floor…two bounces. But if the light is coming from the screens, which are actually emitting light themselves, then the light on the arches is direct, and the floor should show an image of the first bounce. I think. I’ll ask for an explanation.

–

[anonymous_user_52a14607]

@;226876

In the museum demo : https://developer.nvidia/gi-works indirect specular works fine.

What is the use of VXGI if you need to enable SSR? I thought VXGI could do indirect specular by its own.

Yes it can, on a really really good gpu. Try and out all the VXGI specular parameters and see what performance you get.

[Nudlegaru]

@;227075

Yes it can, on a really really good gpu. Try and out all the VXGI specular parameters and see what performance you get.

Lol, I’d better not try that. With the help of , I could enable VXGI for realistic rendering nighroom nolights and it was an overkill for my GTX660M. TBH such tech is an overkill for even a GTX970 like said. To get such tech working fine with the other gameworks tech in a playbale scene, you need , a station of Pascall Cards (the new GTX 1000 and 1100) piles of DDR4, a chain of IBM Power 9 and I think it won’t be enough even for the next Volta cards.

[Bladerskb]

@;226924

Hey Guys

Just took some screens of the Cave with VXGI enabled. I think it looks amazing. Pretty brutal on my PC though. Frame rate went from 86fps to 9fps and thats on a GTX970. But that’s ALL the point lights enabled for VXGI and ALL materials enabled.

ain’t there like hundreds of lights though? i could see why it crawled to 9fps.
But anyway, cave lightning, reminds me of game trailer:
watch?v=VXAa5TCrUfM

[anonymous_user_52a14607]

@;227110

Lol, I’d better not try that. With the help of , I could enable VXGI for realistic rendering nighroom nolights and it was an overkill for my GTX660M. TBH such tech is an overkill for even a GTX970 like said. To get such tech working fine with the other gameworks tech in a playbale scene, you need , a station of Pascall Cards (the new GTX 1000 and 1100) piles of DDR4, a chain of IBM Power 9 and I think it won’t be enough even for the next Volta cards.

That’s why the best optimisation would be to reduce voxel resolution. You will barely notice any drop in quality for diffuse and less glossy speculars will still look good. Its just the highly detailed speculars that will be affected - which is why SSRs can still be useful.

I have found that on my gtx485m an equivalent resolution to what would be vxgimapsize = 16 can run the same scene that I’ve shown at about 20fps with SSRs, ambient occlusion and several soft shadows (im referring to my own opengl engine).

[Nudlegaru]

@;227269

That’s why the best optimisation would be to reduce voxel resolution. You will barely notice any drop in quality for diffuse and less glossy speculars will still look good. Its just the highly detailed speculars that will be affected - which is why SSRs can still be useful.

I have found that on my gtx485m an equivalent resolution to what would be vxgimapsize = 16 can run the same scene that I’ve shown at about 20fps with SSRs, ambient occlusion and several soft shadows (im referring to my own opengl engine).

I don’t recall very well, but I may have seen your GI engine somewhere in youtube (I may be wrong), Isaw the same examples you provided and at thread in video. What is your youtube channel?

[anonymous_user_52a14607]

I still can’t seem to get point light shadows voxelized - its either something to do with the GSceneRenderTargets.GetCubeShadowDepthZTexture(ProjectedShadowInfo->ResolutionX) not actually returning a cubemap depth texture, or maybe my projection matrices are wrong.

Are you guys looking into ?
Also, particles don’t seem to get voxelized either, even when I enable vxgi in the materials.