Is it possible to render the first person completely seperately. Not panini related

Exactly. Do the math, offset the scene capture at the proper distance.