Turns out UE4 actually does sort of do this by default. The settings are under Engine/rendering/culling.