Hey all,I want to implement an API source where I can input the URL, Authorization, etc., and collect data from the API. When creating a connection, the
sources/discover_schema
endpoint needs to be called. Is it possible to dynamically generate schemas for different APIs? If so, how can I achieve that?
k
Kala Aditya
05/23/2023, 7:04 AM
I am not sure if this fits exactly into your use case or not... But I have worked on something similar to this.
Needed to implement a custom source from AWS API Gateway... After testing for more than a week, the conclusion is to use a Python Source. Just create a python source and implement the whole API logic in the discover function to get the schema dynamically... And finally return the API data using the read method. Hope this helps...
Follow this resource for a better idea:
https://docs.airbyte.com/connector-development/tutorials/building-a-python-source