I happended to find the solution myself. All you need to do is to properly set the Behavior-Visibility value in your user widget. In my case, I just set it to Visible for the root widget and Not Hit-Testable (Self) for specific children widgets.
Hope this helps other people who encounter this issue.