Second player in PIE window does nothing, stays static. Shouldn't he behave normally locally (even if he wasn't replicated)?

Multiplayer works right out of the box using the First or Third Person character classes. You only have to define your classes in the world settings of the Level for this to work. Project settings have no baring on this. Level World Settings Game Mode will override project settings.

Op needs to drop more info.