Just to make sure I’m reading this right, you want the waves near the shore to flatten out a bit correct?
added that functionality recently to the Community Ocean Project (link below) where the wave height is modulated based on the landscape heightmap. This is done to the material itself, no extra meshes required.
Below is the material function we use, right click and open the image in a new window to get a better look at it, if it would help you can download the asset from our GitHub repo (it’s in the Content\Ocean\Materials folder named MF_HeightModulation) to try out.
This might be overkill for your situation (is this mobile?), but it could be simplified a bit without too much loss in quality. I hope it helps spark an idea if nothing else. 