VOIP causing LAG, help!!

Any idea why clients would be laggy/jittery/stuttery when using VOIP?
The host looks fine from client’s perspective but whenever a client has VOIP on it makes them lag like crazy for the host. Unsure about client to client lag.

I’m using a basic VOIPtalker and proximity voice is attached to my character’s mesh.
I’m also using steam sockets which seems to have a big effect on the quality of the VOIP.(makes it sound bad and stuttery)

Also using listen servers.

Anyone have any experience with this?
Is it the steam sockets?