Hi all, wanted to know if there is a way to filter out duplicate records (row) in AirByte?

You can use https://docs.airbyte.io/understanding-airbyte/connections/incremental-deduped-history to merge duplicate records

Thanks. Does it compare to a master table to check for duplicates? Because the primary key can be different for duplicates, which would be unique in the master table.

You can defined primary key which you want here in Airbyte connection UI using which we dedup the records.