Imported Alembic drops frame rates heavily

I imported an 8gb alembic animation and my frames went from a constant 120 to below 20fps and 35ms, turning off shadows helps in the editor but when the animation is playing the fps drops again to below 20.