Hi guys, I am working on a destination for ClickH...
# advice-data-transformation
e
Hi guys, I am working on a destination for ClickHouse that supports multiple nodes. The thing about ClickHouse is that its distributed nature means that very specific commands must be used to make sure that data is inserted across nodes and all that good stuff. Basically what this means is that inserting a raw data column into a ClickHouse isn't really convenient, and normalization (as it is called in the Airbyte docs) is a pretty good idea to make your life easy. In this spirit, I want to make normalization available in my destination, but I have so far been unable to figure out who is responsible for applying normalization in Airbyte. From the docs, I get the impression that it is not possible for me to add normalization for this ClickHouse destination, surely that cannot be correct? I find the documentation to be extensive and cover many concepts, and I am sure that is the reason I have missed something, can anyone guide me in how I could achieve custom normalization in my destination? Many thanks, Eric
a
Hi Eric, we temporarily disabled custom transformation on ClickHouse because of a bug that should now be resolved. We will re-enable it soon, please track this issue to get updates on the topic. If you need further assistance please post on our forum, this is where we host most of our community support now.