https://linen.dev logo
Join Slack
Powered by
Hi! I just deployed everything on AWS EC2 but I’m...
# ask-ai
a
Hi! I just deployed everything on AWS EC2 but I’m having problems with the docker container 
airbyte-temporal
. It’s not pointing to the right DB_HOST. I customized the DB:
Copy code
### DATABASE ###
# Airbyte Internal Job Database, see <https://docs.airbyte.io/operator-guides/configuring-airbyte-db>
DATABASE_USER=airbyte_rw
DATABASE_PASSWORD=*****
DATABASE_HOST=prd-datawarehouse.int.main.url
DATABASE_PORT=5432
DATABASE_DB=airbyte
# translate manually DATABASE_URL=jdbc:postgresql://${DATABASE_HOST}:${DATABASE_PORT}/${DATABASE_DB} (do not include the username or password here)
DATABASE_URL=jdbc:<postgresql://prd-datawarehouse.int.main.url:5432/airbyte>
JOBS_DATABASE_MINIMUM_FLYWAY_MIGRATION_VERSION=0.40.26.001
An the docker-compose.yml is like this
Copy code
airbyte-temporal:
    image: airbyte/temporal:${VERSION}
    logging: *default-logging
    container_name: airbyte-temporal
    restart: unless-stopped
    environment:
      - DB=postgresql
      - DB_PORT=${DATABASE_PORT}
      - DYNAMIC_CONFIG_FILE_PATH=config/dynamicconfig/development.yaml
      - LOG_LEVEL=${LOG_LEVEL}
      - POSTGRES_PWD=${DATABASE_PASSWORD}
      - POSTGRES_SEEDS=${DATABASE_HOST}
      - POSTGRES_USER=${DATABASE_USER}
    volumes:
      - ./temporal/dynamicconfig:/etc/temporal/config/dynamicconfig
    networks:
      - airbyte_internal
but the temporal server keeps restarting with the logs:
Copy code
2023-05-15T04:41:18.615Z	ERROR	Unable to create SQL database.	{"error": "unable to connect to DB, tried default DB names: postgres,defaultdb, errors: [pq: no pg_hba.conf entry for host \"10.0.101.173\", user \"airbyte_rw\", database \"postgres\", no encryption pq: no pg_hba.conf entry for host \"10.0.101.173\", user \"airbyte_rw\", database \"defaultdb\", no encryption]", "logging-call-at": "handler.go:97"}
Important! host \“10.0.101.173\” ---> THIS IS THE LOCAL IP NOT 
<http://prd-datawarehouse.int|prd-datawarehouse.int>.main.url
 and database must be 
airbyte
Did anyone had this problem?
👀 3
k
A message from kapa.ai
Sorry @Alan Szpigiel, I seem to be having a bit of trouble. Don't worry though, I've pinged my support folks and they will try to fix me up! 🧑‍💻 Perhaps try again in 5mins?
a
are you ok?
@kapa.ai
k
A message from kapa.ai
Sorry @Alan Szpigiel, I seem to be having a bit of trouble. Don't worry though, I've pinged my support folks and they will try to fix me up! 🧑‍💻 Perhaps try again in 5mins?
a
I just saw this also:
Copy code
airbyte-temporal  | touch: CONTAINER_ALREADY_STARTED_PLACEHOLDER: Permission denied
@kapa.ai
k
A message from kapa.ai
Sorry @Alan Szpigiel, I seem to be having a bit of trouble. Don't worry though, I've pinged my support folks and they will try to fix me up! 🧑‍💻 Perhaps try again in 5mins?
a
@kapa.ai
k
A message from kapa.ai
Sorry @Alan Szpigiel, I seem to be having a bit of trouble. Don't worry though, I've pinged my support folks and they will try to fix me up! 🧑‍💻 Perhaps try again in 5mins?
a
@kapa.ai
k
A message from kapa.ai
Sorry @Alan Szpigiel, I seem to be having a bit of trouble. Don't worry though, I've pinged my support folks and they will try to fix me up! 🧑‍💻 Perhaps try again in 5mins?
a
@kapa.ai
k
A message from kapa.ai
Sorry @Alan Szpigiel, I seem to be having a bit of trouble. Don't worry though, I've pinged my support folks and they will try to fix me up! 🧑‍💻 Perhaps try again in 5mins?
s
a
o
Hey @Alan Szpigiel got the same issue. I only use the docker-compose.yaml and its .env, i changed accordingly the .env for my own postgres and remove the airbyte-db. Did you resolve it ?
a
nop…
still appearing the same issue
:S
b
@Alan Szpigiel, hello! Did you ever find a workaround for this? I am having the same issue.
a
Nop!
So strange that is not working
I tried a week ago on last version and nothing
b
Dang! Thanks for the update. I'll let you know if I learn more.
l
@Alan Szpigiel did you figure this out? I am having the same issue
a
not yet!
l
I may be close. I will update you if I get it to work.
@Alan Szpigiel and @Omar Allouache I got this to work. Let me know if this works for you: I had to update the environment variables in the docker-compose.yaml for the airbyte-temporal service. I added the following 4 rows to the environment variables:
Copy code
- SQL_TLS=true
      - SQL_TLS_DISABLE_HOST_VERIFICATION=true
      - SQL_TLS_ENABLED=true
      - SQL_HOST_VERIFICATION=false
here is what the airbyte-temporal service portion of the docker-compose.yaml now looks like:
Copy code
airbyte-temporal:
    image: airbyte/temporal:${VERSION}
    logging: *default-logging
    container_name: airbyte-temporal
    restart: unless-stopped
    environment:
      - DB=postgresql
      - DB_PORT=${DATABASE_PORT}
      - DYNAMIC_CONFIG_FILE_PATH=config/dynamicconfig/development.yaml
      - LOG_LEVEL=${LOG_LEVEL}
      - POSTGRES_PWD=${DATABASE_PASSWORD}
      - POSTGRES_SEEDS=${DATABASE_HOST}
      - POSTGRES_USER=${DATABASE_USER}
      - SQL_TLS=true
      - SQL_TLS_DISABLE_HOST_VERIFICATION=true
      - SQL_TLS_ENABLED=true
      - SQL_HOST_VERIFICATION=false
    volumes:
      - ./temporal/dynamicconfig:/etc/temporal/config/dynamicconfig
    networks:
      - airbyte_internal
a
late to the party but the above worked for me, thanks! 🙇
Open in Slack
PreviousNext
Powered by