Light specular reflections visible through walls

Hi, I am working on a map that has some houses on it and in the houses I have noticed that all of my inhouse and also street lights have their specular visible through walls. Now I have seen and read the topic posted in 2016 Specular reflections visible through walls but my issue is a bit different as I don’t have any baked information and all of my lights are movable. So no reflection captures at all on the scene.
The walls that I am using have enough thickness so thin walls are not the issue here.

I have noticed that turning on/off shadow casting on the lights has no effect on this issue

The workaround I’m thinking about would be to use different light channels for different rooms but that can’t be used in a situation where you have a light let’s say in a bedroom that has to light up the hallway floor and walls you are standing in when you open that bedroom door (image 2)

Is there a way to fix this or another workaround?

As you mentioned, turning off shadow casting won’t affect this, it only turns off the shadows not the light (or specular reflection).

However, you can still build Reflections captures even if you don’t have baked light. You can have multiple reflection captures in the level so the reflection is different from when you are outside vs inside.