I came across this thread because my newly created landscape chunks were not unloadable at all. For me, the solution was to set “WorldPartitionRuntimeSpatialHash” after that, I unticked “Enable Streaming” and then ticked it again. After doing this, the landscape became fully loadable and unloadable using the World Partition Tool.
I used UE5.5, hope this will help someone out there. 