Hey team, I just wonder how I can delete datasets...
# ingestion
p
Hey team, I just wonder how I can delete datasets that are ingested from a particular job/pod without DataHub CLI? I’ve read the https://datahubproject.io/docs/how/delete-metadata/ part however I’m not utilizing DataHub CLI. What should I do in k8s enviornment in order to rollback a particular run id?
b
You can either use the CLI to rollback the run (using the assigned runID) or otherwise you would need to remove the data directly from mysql and elasticsearch
s
Why can you not use datahub CLI? Create a pod with metadata-ingestion image, go inside the pod and you will have the CLI ready for use.
p
Thank you @bland-orange-95847 @square-activity-64562! I didn’t know that I can access to CLI in metadata-ingestion pod 🙂 Let me try that
Copy code
datahub@ingestion:/$ datahub ingest list-runs
+--------------------------------------+--------+---------------------+
| runId                                |   rows | created at          |
+======================================+========+=====================+
| hive-2021_11_16-12_21_04             |   8630 | 2021-11-16 12:30:25 |
+--------------------------------------+--------+---------------------+
| hive-2021_11_16-11_54_11             |   1889 | 2021-11-16 12:08:56 |
+--------------------------------------+--------+---------------------+
| hive-2021_11_16-08_25_36             |   4403 | 2021-11-16 08:34:11 |
+--------------------------------------+--------+---------------------+
| hive-2021_11_16-06_07_24             |   2045 | 2021-11-16 06:23:58 |
+--------------------------------------+--------+---------------------+
| hive-2021_11_16-05_57_05             |  10847 | 2021-11-16 06:04:07 |
+--------------------------------------+--------+---------------------+
| no-run-id-provided                   |   6065 | 2021-11-15 12:28:12 |
+--------------------------------------+--------+---------------------+
| looker-2021_11_09-18_53_19           |  15129 | 2021-11-09 18:54:38 |
+--------------------------------------+--------+---------------------+
| f019bbe0-2618-11ec-a490-96d386678a71 |  15271 | 2021-10-05 20:16:52 |
+--------------------------------------+--------+---------------------+
| 8182cd06-1abb-11ec-aad2-a2291caf05be |    843 | 2021-09-21 09:08:55 |
+--------------------------------------+--------+---------------------+
| 81768848-1a57-11ec-b45e-56af68178eb0 |   2114 | 2021-09-20 21:33:50 |
+--------------------------------------+--------+---------------------+
you saved my day @square-activity-64562! 🙂
s
Added https://github.com/linkedin/datahub/pull/3589 so it is clear. The docs seem to be missing this information. Should help others in future
🚀 2
💯 1