I figured out the issue, it was the 12 spotlights I had in the environment. They were set to stationary. Changing them to movable or static made my frame rate go from 5 fps to 110 fps. I thought stationary is faster to render than moveable. Odd, I set them to static for extra performance.