[Mauzen]

Removing objects of the normal world wont cause frequent lags. It might just cause some lag for the players when joining, especially when removing everything, as the network traffic for this already is a lot.
Creating the map far away from the normal map would work in general, but there are some other problems for the players when going far off the common bounds.
Some people got millions of objects loaded with the streamer, after all it just depends on how strong the server youre using is.