From what I understand, how you configure the Infra Assistant is up to you. You might have a need to run two different datacenters that have different requirements and you may need to use different services.
For example, I think that with Azure OpenAI and Data Zones you can setup something for GDPR in European counties, and have a separate service for the United States.
In those cases, you might want to configure it differently, if your primaries need it.
However, I don't believe it's a requirement to do so. They should be able to all be configured to point at the same service if you wanted to.