I have an idea that might be a bit out there. We'd really love to leverage Airbyte cloud, but we have some specifications about where our data can go both in transit and at rest and are currently implementing with the helm chart on k8s in our VPC. Most of that movement of data seems to be done by some

socat

pods that get spun up in the k8s cluster. I wonder if there could be a strategy that is could hosted for metadata, logs, RBAC, SSO/SAML, etc but an agent is deployed locally that establish a TCP connection with an Airbyte endpoint. The agent would then spin up the pods for moving data the same as it does today and collect logs and other metadata and ship it to Airbyte.