Computing dense optical flow with scene capture component 2D

Couldn’t you just sample the velocity buffer directly and transform the world space velocity vectors into view space?