Hey team. We use Airbyte to sync between Airtable ...
# help-connector-development
m
Hey team. We use Airbyte to sync between Airtable and a data warehouse. The Airtable schemas change quite a lot, and it's pretty annoying to have to keep refreshing the source schema and resetting the data. Therefore, I'd like to programmatically trigger an update of refresh and reset of my airtable source/connection on a nightly basis. I previously opened a similar ticket. The attached script show my attempt so far, but it doesn't work because the
write_discover_catalog_result
endpoint requires a
configurationHash
that I don't know how to create. (The docs for `write_discover_catalog_result` also say "Should only called from worker", so I assume I'm doing something wrong). Can anybody give me some pointers how to either generate the source config hash, or if there is a better way to update the source definition? (ps. I know this is not strictly a CDK question, and more about the usage of the API, but I hoped I might get a better answer from this channel 🙏)
ah, looks like I should be using the
web_backend
endpoints, get and update airbyte
n
Hey @Mark Nuttall-Smith just to confirm - you were able to programmatically refresh schemas?