Nanite uses the proxy mesh for complex collision, you can increase the precision and triangle count of the proxy.