You need to cut your meshes into much smaller pieces. From your picture, you have the entire scene as one large high poly mesh. It each room needs to be made from, say, 20-30 meshes, each of which must be MUCH more low poly.
Then all you problems will dissapear…