Hey guys, let’s suppose we have 3 druid clusters, ...
# general
s
Hey guys, let’s suppose we have 3 druid clusters, A, B and C. In each one of the clusters, there is a datasource, called ds1. So, there is a ds1 in A, in B and in C. These datasources have the same schema, but different data. Is it even possible to be merging the ds1 from A, B and C into a new cluster Z? The new cluster Z will have a datasource ds1-merged and the data from ds1 (A/B/C) needs to be ingested or brought into the new final datasource. Is there going to be an issue because of __time overlapping segements?
b
I think this should be doable. One approach is a native reindexing job with a "combining" datasource. Another would be to copy from one at a time, using appendToExisting. A third (easiest?) way, using MSQ and SQL, would be to select a union of the datasources, and ingest it into the new one.