Plugin Hot Reload

It is not. Check if you have set up your plugin properly and if its not an editor plugin.
There are some constraints to using the module window, but I have no clue what they are.
It definitely works for enabled plugins that have runtime modules. (Maybe you didnt enable your plugin for your project?)