Hi! I’m currently using JDBC connection (on Spark)...
# ask-community-for-troubleshooting
j
Hi! I’m currently using JDBC connection (on Spark) to fetch a couple of Db2 tables for analytical use. I am considering using an ingestion tool. I wonder how Airbyte performs the db2 incremental append sync. The connector documentation mentions only
GRANT CONNECT
. Wouldn’t it need a lot more grants? For comparison, AWS DMS wants a user to have
SYSADM
(?!) and
DATAACCESS
. Debezium puts tables into a capture mode using ASN Capture/Apply agents, which sounds a bit scary on any production-related databases.
1
a
Hi @Jani Sourander, Our DB2 connector does not support CDC. Incremental loads will work if your source table has a column that can be used as a cursor. Airbyte stores the latest cursor value on each job run, and the next run picks up all the records where cursor value > latest stored cursor value. This incremental logic does not require more permission than a classic read.
j
Ok, thanks for the reply. That makes sense.