Actually, I just did some further testing on this and the trick is to to do two ray traces. Cast the first from the player camera perspective.
Then do a second trace using the impact point from the first as your end point and the weapon as your start.
Your exact setup will vary a bit, but the end result is right on the crosshair if you have it set at screen center.
