So, I accidentally solved this, but I have no idea why it works. Adding empty sibling state is solving an issue. So everything is the same except my state tree look like this. Weird fix, but ok.