Did you check the vertex color settings when importing? It might be you have to switch to “Replace” so it imports the vertex color from the mesh and doesnt stomp it with a white.
You can fix it by going to the import settings in the mesh, make the change and then Reimport.
