Hi all, I sat up a postgres to bigquery connection like this: https://airbyte.com/tutorials/postgres-to-bigquery and I wanted to extract data in an Incremental way and load it using Deduped + history mode. However, when I set it up like that I get the following message:

The form is invalid. Please make sure that all fields are correct.

Any idea what I'm doing wrong?

You need to select the cursor field for each incremental stream. https://glossary.airbyte.com/term/cursor/

thank you Alex. I selected the cursor field, but I'm still getting an error when synching

Failure Origin: source, Message: Something went wrong in the connector. See the logs for more details.

I checked the logs, and I see it is because permission to the schema is denied. This is very surprising as I followed your guide here, and I tested your db without issues

It looks like the user and/or password you have defined in the connector may be having issues connecting to the source database

I did re-test the connection and it doesn't give me an error

are you definitely able to login to the database with the “airbyte” user and the password that you made use of in the source connector? (the test you did above validates the privileges, but not the password)

image.png

yes, that looks like a different schema than what you validated above. What’s the result if you try reading the wawa schema from the airbyte user?

I just checked and my user can't access the schema

Have you tried granting SELECT ?

Yes! So I figured out that the user that I was granting access from didn't own the schema, so it couldn't do it (although it didn't give me an error when running the command) very confusing