Hello everyone, I am having an issue with data transformation on clickhouse with airbyte, can you please help me or you can connect me with someone who can help, Issue:- When airbyte is migrating my data to clickhouse then my materialized view is not executing, ideally it should trigger just after data gets inserted to to the table. Airbyte version:-0.40.21 and logs for support

I asked internally at ClickHouse and got the following answer:

Incremental models do a table swap in most cases. Since the insert is into a temporary table (which is eventually swapped/renamed into the original table), the MV insert trigger is not activated.

This is due to how the MVs work in ClickHouse: an insert trigger that operates per block insterted

Hello Abhijeet Singh, it's been a while without an update from us. Are you still having problems or did you find a solution?

Is it has been solved after update

@Abhijeet Singh How did you solve it? I'm having the same problem, Airbyte is using EXCHANGE TABLES and not directly inserting into my table where MaterializedView is targeting.

Hi @Learie Hercules @Abhijeet Singh I'm facing the same issue while replicating data to clickhouse using airbyte - can you please help me understand if/how this was resolved?

Hi, @Manjeet Thadani did you found the issue?