System to Create 3D Elements Behind Tilemap Tiles?

Here is my current setup:

In the video, you can see a tilemap existing in the sample 3d side scroller template level. Currently, the tilemap has a collision thickness of 50, so the character can collide with tiles and such, but since this is a 3d world and I’m using a perspective camera, it looks like my character is walking on air. Because of this, I want to create these blocks that would go behind each tile and preferably have their texture mimic the tile they are behind, something like this: https://i.imgur.com/8lGikW6.png

Is there a way to do this? Right now I am using blueprint only but I can always switch to C++.