This message was deleted.
# general
s
This message was deleted.
a
If you want to rename datasource A to datasource B, I think it'll involve a few more steps than just reindexing if active kafka ingestion is running on datasource A. 1. Suspend kafka ingestion on datasource A 2. Wait for the existing tasks on A to succeed 3. Copy the stream offsets in the for datasource A to a new entry for datasource B. This can be done by editing entries in
druid_datasource
table in the metadata store that you are using. This step is needed to begin ingestion in datasource B exactly where kafka ingestion was left off in A 4. Copy the supervisor for kafka ingestion in A and resubmit it for datasource B
u
@Amatya Avadhanula thanks you for answer, I have one more question. Can I directly add a column with B dataSource information to the
druid_datasource
table, and then copy the contents of the column with A data Source information?
a
What is the retention period of your kafka topic? Does it have all the data that you want or is it partially present in datasource
A
and partially in the topic?
u
@Amatya Avadhanula It has 1h retention period. And it has all the data in A dataSource.
a
Oh, then you could simply create a kafka supervisor for datasource B and read from that topic directly
Does that not work?
u
I haven't tested yet. Before starting the test, I left a question for confirmation.
👍 1
a
If all the data is in the kafka topic, you could just create a new kafka supervisor and replace the datasource name. You do not need to reindex from A (the previous datasource)
u
@Amatya Avadhanula thanks you
👍 1
@Amatya Avadhanula i'm sorry i have one more question... How can I move the data accumulated in deep storage?
a
Move or remove?
If it is to remove / delete data, https://druid.apache.org/docs/latest/data-management/delete.html will be helpful
u
For example, deep storage stacked via A DataSource is /data/segments/A/{time}/~~ if I want to move it to /data/segments/B/{times}/~~~, can I simply change the path?
a
No, I don't think that would work
u
@Amatya Avadhanula Is there any way?
a
There isn't a way to transfer data within deepstorage for a different datasource
You could use reindexing and append data in A to B
Or you could use MSQ
👍 1
u
@Amatya Avadhanula Thanks for the answer, it helped me a lot
👍 1