Hi, I am new to airbyte. Need to ask few questions. Can we hit REST/SOAP API's using destination in open source airbyte implementation? I was unable to find any destination connector? Also for the source there is only Public API (cant we specify API of our own to get data from). Also I am unable to find these answers in documentation. If anyone can help that would be appreciated. Or provide me documentation reference. TIA

Hey @Talha Asif, do you have a specific destination connector you're looking for? Regarding using your private API, it's definitely possible to build a custom connector for your API and use it internally. You can learn more about connector development here: https://docs.airbyte.com/connector-development/

Thankyou @Sunny Hashmi (Airbyte) I was able to build custom destination and source. Now I am looking for solution where I can create a connection on run time using code. Get data from source do some transformation or implement some business logic and send it to destination. Can you tell me if that is possible and reference documentation would be very helpful.

Since Airbyte is an ELT tool, transformations are performed after loading into the destination. You can create connections and run syncs using the web UI, octavia-cli or by calling the public API. Once the sync is complete, it's possible to run transformations and even integrate them into Airbyte, here's the tutorial: https://docs.airbyte.com/operator-guides/transformation-and-normalization/transformations-with-sql

Ok thankyou. Let me look into it.

I’m having the same problem. Did you get any solution @Talha Asif?