https://linen.dev logo
Join Slack
Powered by
Hi all Looking to deploy airbyte on prem and want...
# ask-ai
r
Hi all Looking to deploy airbyte on prem and wanted to ask if the docker container running airbyte inherits the VPN of the host? I need to read data from a "local" database on the same network and would like to get some input on the possibility of doing so?
k
A message from kapa.ai
Yes, the Docker container running Airbyte should inherit the network settings of the host, including the VPN connection. However, depending on your Docker network configuration, you may not be able to connect to 
localhost
or 
127.0.0.1
directly. If you are running into connection refused errors when running Airbyte via Docker Compose on Mac, try using 
host.docker.internal
as the host. On Linux, you may have to modify 
docker-compose.yml
and add a host that maps to your local machine using [
extra_hosts
](https://docs.docker.com/compose/compose-file/compose-file-v3/#extra_hosts) ([source](https://docs.airbyte.com/troubleshooting/new-connection)). In a [previous support conversation](https://airbytehq.slack.com/archives/C021JANJ6TY/p1664872186651399), a user was able to connect to a local SQL Server instance by using the appropriate hostname (e.g., 
localhost
or 
host.docker.internal
). Make sure to configure your Docker network and security settings accordingly to allow the Airbyte container to access the local database on the same network.
j
It is just a big docker compose configuration so you could modify the docker-compose.yml to set which network the containers connect to.
👍 1
r
Thanks for that Jason. I will need to have a look when deploying. I'm new to docker however and since airbyte is executed with a .sh script, im not sure how or where to modify the docker-compose.yml. Do you have a link to a ressource perhaps?
j
I am assuming that you are referring to this script and you can see how if you run it with 
-d
it will only download the relevant files from github and not run docker compose. You should be able to then inspect and edit the 
docker-compose.yaml
in the same directory where the script has been run from. There is also a 
.env
file where you can set overrides and other options for docker compose.
🙏 1
🙏🏽 1
o
Hi, thanks ! Do we need to clone the entire repo to run airbyte on prem ? I am trying to run it with only the 
docker-compose.yaml
and 
.env file
and trying to disable airbyte db to use my own postgres but it gives errors with temporal service. Could you help ? https://github.com/airbytehq/airbyte-platform/blob/d2d411facbf9c5fb7c5623c35fb1ee641865fced/docker-compose.yaml and https://github.com/airbytehq/airbyte-platform/blob/d2d411facbf9c5fb7c5623c35fb1ee641865fced/.env#L59
j
You should not need to clone the entire repo to run on-prem because everything you need will be in the docker images that are pulled when you 
docker compose up
❤️ 1
c
I have a similar requirement of being able connect to local databases on my vpn network. Is the recommended solution to get the docker-compose.yaml and .env files, modify it to use host network?
Open in Slack
PreviousNext
Powered by