Alasdair Ellis
09/25/2024, 10:15 AMuser
09/25/2024, 10:15 AMAlasdair Ellis
09/25/2024, 10:15 AMuser
09/25/2024, 10:15 AMuser
09/25/2024, 10:15 AMAlasdair Ellis
09/25/2024, 10:16 AMuser
09/25/2024, 10:16 AMuser
09/25/2024, 10:17 AMsql CREATE USER <user_name> PASSWORD 'your_password_here';
2. Provide read-only access to relevant schemas and tables: You need to grant this user read-only access to the schemas and tables you want to replicate data from. Run these commands for each schema: sql GRANT USAGE ON SCHEMA <schema_name> TO <user_name>; GRANT SELECT ON ALL TABLES IN SCHEMA <schema_name> TO <user_name>; ALTER DEFAULT PRIVILEGES IN SCHEMA <schema_name> GRANT SELECT ON TABLES TO <user_name>;
3. Provide additional REPLICATION
permissions for CDC: If you are configuring your Postgres source with Change Data Capture (CDC), you need to grant REPLICATION
permissions to the read-only user: sql ALTER USER <user_name> REPLICATION;
Please note that for CDC, you must connect to primary/master databases. Pointing the connector configuration to replica database hosts for CDC will lead to failures. Sources: - [Postgres Source Quick Start](https://docs.airbyte.com/integrations/sources/postgres#quick-start) - [Setup using CDC](https://docs.airbyte.com/integrations/sources/postgres#setup-using-cdc)Alasdair Ellis
09/25/2024, 10:27 AMuser
09/25/2024, 10:27 AMuser
09/25/2024, 10:27 AMsql GRANT USAGE ON SCHEMA <schema_name> TO <user_name>; GRANT SELECT ON ALL TABLES IN SCHEMA <schema_name> TO <user_name>; ALTER DEFAULT PRIVILEGES IN SCHEMA <schema_name> GRANT SELECT ON TABLES TO <user_name>;
Replace <schema_name>
with the name of the schema and <user_name>
with the name of the user. Remember, these schema names are case-sensitive. If no schemas are set explicitly, Airbyte will sync all existing schemas for which the user has the necessary permissions. Source: [Postgres Source Quick Start](https://docs.airbyte.com/integrations/sources/postgres#quick-start)Alasdair Ellis
09/25/2024, 10:29 AMuser
09/25/2024, 10:29 AMuser
09/25/2024, 10:30 AMUSAGE
and SELECT
permissions on the schema and its tables. You can check and update these permissions as described in the [Postgres Source Quick Start](https://docs.airbyte.com/integrations/sources/postgres#quick-start) guide. 2. Incorrect Schema Name: The schema name specified in the connector configuration might be incorrect. Schema names in Postgres are case-sensitive. Make sure the schema name matches exactly with the one in your Postgres database. 3. Empty Schema: The schema in your Postgres database might be empty, i.e., it does not contain any tables. Airbyte's discovery process checks for the schema and table structure, not the actual data within the tables. Therefore, if there are no tables in the schema, no streams will be detected. 4. Connector Version Issues: There have been instances where certain versions of the Postgres source connector had issues detecting tables. For example, version 0.4.10 had a [known issue](https://github.com/airbytehq/airbyte/pull/12689) which was fixed in version 0.4.14. Make sure you are using a version of the connector that does not have this issue. If none of these solutions work, consider reaching out to the Airbyte community or support for further assistance.