Hi All, Do we have some tools to migrate data from...
# generalc
Charles
07/30/2021, 1:09 AMHi All, Do we have some tools to migrate data from ClickHouse to Pinot? thx
k
Kishore G
07/30/2021, 1:50 AM
I think Clickhouse has a export command
Kishore G
07/30/2021, 1:50 AM
Should be simple to build a tool around that
c
Charles
07/30/2021, 1:53 AMOk thx
x
Xiang Fu
07/30/2021, 4:29 AM
if u can dump data from ch to parquet then you can build pinot segment from the parquet file
Xiang Fu
07/30/2021, 4:30 AM
please note pinot segments is 1:1 mapping from parquet files, so don’t use one giant file, you can try to split data to multiple parquet files and partitioned by date etc
c
Charles
08/03/2021, 1:03 AMThx @User