Learning agents Episode limit

Could it just be the action noise?