Also trying to create a clickhouse destination res...
# supportf
fancy-arm-55508
05/04/2023, 4:07 PMAlso trying to create a clickhouse destination results in errors
a
average-tailor-86667
05/04/2023, 4:12 PMWhat Object Storage Configuration you are providing?
f
fancy-arm-55508
05/04/2023, 4:12 PMs3 role based
👍 1
a
average-tailor-86667
05/04/2023, 4:36 PMCan u try creating the destination without s3 role based. Basically provide some random values there, get the destination created. Once the destination is created, try updating it with s3 role based.
f
fancy-arm-55508
05/04/2023, 4:37 PMGood idea, will try. i was trying to setup the clickhouse destination as a workaround for not being able to get kafka destination to work
👍 1
a
average-tailor-86667
05/04/2023, 4:39 PMChecking with the team around the issue.
h
hundreds-lifeguard-65770
05/04/2023, 4:51 PM@fancy-arm-55508 still going 😢
f
fancy-arm-55508
05/04/2023, 4:53 PMits been a journey @hundreds-lifeguard-65770 im finally on the connector between MSK and clickhouse, but running in to issues i believe are caused by manually setting kafka ACL (for rudderstack SASL) and IAM (for the connector)
😫 1
h
hundreds-lifeguard-65770
05/23/2023, 6:49 AM@fancy-arm-55508 did you get it working!
f
fancy-arm-55508
05/23/2023, 6:55 AMi got rid of MSK and clickhouse 😄
fancy-arm-55508
05/23/2023, 6:55 AMwent with rudderstack -> firehose -> redshift
fancy-arm-55508
05/23/2023, 6:55 AMmeans it can all be in terraform, and it works without issues. i forgot how fickle kafka connectors can be
h
hundreds-lifeguard-65770
05/23/2023, 7:28 AMredshift 😢!
f
fancy-arm-55508
05/23/2023, 10:27 PMwould love to have tried clickhouse, seen it being used in other products. but getting data into it in realtime from rudderstack wasnt easy
h
hundreds-lifeguard-65770
05/24/2023, 8:14 AMyeah - a shame rudder doesnt offer a closely knit kafka offering so you dont have to stand it up