How to pause a game on dedicated server but not on clients

I’m working on a physics based multiplayer game prototype. Idea is to simulate and pause physics in turns on server, simulated actors are synced on clients. I got the second part working but having some problem with pausing the game on server. It should happen automatically on timer in GameState, not by players invoking the pause.

I’ve tried to use SetGamePaused in BP but without effect. I can pause via PlayerController::SetPause but it also pauses game on all clients.
Enabling and disabling simulation on individual bodies is not an option since it resets the velocities.

Ideally I would like to pause physics only but normal pause that happens on server only is also welcomed.
Any ideas?