switching characters loses ai controller

Hello, I want to setup a mode where I can switch between three playable characters, f.e.:
Numpad 1 - Character 1
Numpad 2 -Character 2
Numpad 3 -Character 3

The two characters that are not possesed should always follow the playable one, independently from what character is possesed.

Here is what I setup:
-Created a new AI Controller, with the repeating “AI Move to player” logic
-Added 3 BP_Char to the level and put this new AI Controller into them
-Added the “posses switch logic” to the Level Blueprint

Now when I start game the other two will follow, but here is the problem:

When I switch to another character the one that got unpossesed loses its controller, and therefore stops following, in the Debug mode it is shown with “NoController”

How can I fix this?