https://linen.dev logo
#troubleshooting
Title
# troubleshooting
g

Gabriel Souza

02/18/2022, 3:26 PM
Hello guys! Me again! I got a new problem! I made a connection source Postgres to destination Bigquery using CDC follow all documentation steps. Made a test for my staging database and works fine, when I move to production i got a error
Copy code
ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null
There any thing I could do? OS Version/Instance: ec2.t2.large Memory/Disk: 8Gb/ 50Gb Deployment: Docker EC2 Source name/Version: Postgres version 0.4.7 Destination name/Version: Bigquery 0.6.8 Airbytes Version: 0.35.4-alpha
m

Madhu Prabhakara

02/18/2022, 11:46 PM
The main reason of this failure was:
Copy code
2022-02-18 15:09:37 [44msource[0m > 2022-02-18 15:09:37 [1;31mERROR[m i.d.p.ErrorHandler(setProducerThrowable):31 - Producer failure
2022-02-18 15:09:37 [44msource[0m > io.debezium.jdbc.JdbcConnectionException: FATAL: must be superuser, replication role, or rds_replication role to start walsender
2022-02-18 15:09:37 [44msource[0m > 	at io.debezium.connector.postgresql.connection.PostgresReplicationConnection.initPublication(PostgresReplicationConnection.java:180) ~[debezium-connector-postgres-1.4.2.Final.jar:1.4.2.Final]
2022-02-18 15:09:37 [44msource[0m > 	at io.debezium.connector.postgresql.connection.PostgresReplicationConnection.initConnection(PostgresReplicationConnection.java:316) ~[debezium-connector-postgres-1.4.2.Final.jar:1.4.2.Final]
2022-02-18 15:09:37 [44msource[0m > 	at io.debezium.connector.postgresql.connection.PostgresReplicationConnection.startStreaming(PostgresReplicationConnection.java:289) ~[debezium-connector-postgres-1.4.2.Final.jar:1.4.2.Final]
2022-02-18 15:09:37 [44msource[0m > 	at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.execute(PostgresStreamingChangeEventSource.java:106) ~[debezium-connector-postgres-1.4.2.Final.jar:1.4.2.Final]
2022-02-18 15:09:37 [44msource[0m > 	at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:140) ~[debezium-core-1.4.2.Final.jar:1.4.2.Final]
2022-02-18 15:09:37 [44msource[0m > 	at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:113) ~[debezium-core-1.4.2.Final.jar:1.4.2.Final]
2022-02-18 15:09:37 [44msource[0m > 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
2022-02-18 15:09:37 [44msource[0m > 	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
2022-02-18 15:09:37 [44msource[0m > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
2022-02-18 15:09:37 [44msource[0m > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
2022-02-18 15:09:37 [44msource[0m > 	at java.lang.Thread.run(Thread.java:833) [?:?]
2022-02-18 15:09:37
Can you check the configuration of your CDC in the production database?
4 Views