Edge detection for the *material*, not the mesh

Perhaps isolating part of the image via custom depth mask + guassian blur + desaturation could get you partly there

Guassian blur custom material node

Custom depth buffer