How safe depends on how you manage the lifetime of those actors. The issue you will have is when actors in that array are destroyed and cleared by the GC you now have dangling pointers, once you try to access any of those actors you will crash.
If you really have to go with that array I would suggest binding to the event on destroyed for each actor added, this way you can remove any actors that are pending kill.