I fixed my problem by diving into the source code, I inserted a new array of extra hidden actors on the player controller and then added a line to append it to the hidden actors array that is built by the game (I assume for occlusion culling purposes).
Now I can insert actors that I don’t want the player to see into the extra actors array using blueprint, works like a charm!