Client to server RPCs will only work on an actor that is owned by the local client.
If you need a non-owned actor to get some sort of input from a client, you will need to route that input through the local clients player controller.
Or did I read you wrong? 