Hello. I am trying to generate a dynamic schema from a source api. I saw this answer from alafanechere:
"Dynamic schema change is not something supported by Airbyte at the moment.
Your connector must be able to know the schema of the records it will handle before running a replication.
You can implement your own discover method on your Source to infer a dynamic schema from a source, but this schema should not change from sync to sync.
You can checkout our Salesforce connector to check a custom implementation of discover."
https://discuss.airbyte.io/t/custom-source-connector-dynamic-response/897
Could alafanechere or someone else point out where in the Salesforce connector this is done? I could not find where they implement their own discover method.
In the Airbyte UI, whenever you click "Set up connection", I assume that this looks for the schema files? Do you know if the Salesforce connector or any other implementation can query the API for the schema at this point? In my code, I do override the get_json_schema() method. Here is my code if interested:
https://github.com/NMWDI/airbyte/blob/ckan-jdm/airbyte-integrations/connectors/source-ckan/source_ckan/source.py#L123
Thanks!
David