Object visibility when using movie render queue and sequencer

I’ve set up a level with a few different setups of objects and materials. I’m using the sequencer to change position of camera as well as switch on and off the visibility for geometry.

It was my hope that I could just send every 10th frame to render and I’d have some variations on my render based on what i’d keyframed in the sequencer.

However what I actually get, (with the path tracer and also the standard renderer) is all objects in the scene turned on for all frames.

I’m using group actors to change the visibility of different sets of objects but Ideally I’d like to control this in the layers panel. I can’t see if this is possible however.

Here are some images to illustrate…