Apple Silicon can access all memory for VRAM thanks to Unified memory. Also, both CPU and GPU are already powerful enough to use for game development. The memory itself is already fast. I dont think that would be an issue.
5 Likes