Ok, so turns out that planar reflections was super easy (just tick the box in the material).
Iām still interested in a way of fake extending the ocean all the way up to the skybox.