Media files are not played after the project is packaged

I had a similar issue in 5.0.3 and it turned out after switching the level, I forgot to add the blueprint which contained the media player to run the videos. Because in-editor I was still testing with the old level it took a moment to figure this out.