In stead of toggle visibility you should activate/deactivate the particle system. Also uncheck auto activate on the component.
In stead of toggle visibility you should activate/deactivate the particle system. Also uncheck auto activate on the component.