Anywhere you can get away with it. Including walking into buildings.
If you are making an MMO things would be slightly different with the loading/unloading process. Normally that’s all handled server side, so the setups are different… GTA5 is peer to peer - but you can see that for the online version they had to cut back on some visual things too - wild animals for instance.