I found the issue, in blender my decimate was too small and it created loads of tiny holes in the mesh.