Ideally, you can predict that ahead of time and leave room in the namespace. For example, if you want to allow for 4 simultaneous tests, limit tests to 25% of the namespace.
It's possible to start a test covering 100% of the namespace and change it halfway through to only include 50%. It could introduce some noise to the results and might open you up to Simpson's paradox though.