Is this a good use case of using object pooling to avoid spawning/destroying actors?

Yes.