https://datahubproject.io logo
Join Slack
Powered by
Trying to use this transformer option transformers...
# ingestion
h
Trying to use this transformer option transformers: - type: "mark_dataset_status" config: removed: true Any configuration to be done?
m
@handsome-football-66174: are you trying to delete some metadata that you just ingested?
h
No was trying to see if the dataset was not visible for the UI. Following this https://datahubproject.io/docs/metadata-ingestion/transformers/
m
you mean... trying to understand why the dataset is not visible?
or trying to hide the dataset?
h
I meant hiding the dataset
m
you could just delete the metadata about the dataset using the datahub cli. https://datahubproject.io/docs/how/delete-metadata/#delete-by-urn
is this just 1 out of many many datasets that you want to remove from the UI?
h
So how can we achieve this via the .yml file rather than the cli
m
you would add this transformer to your ingestion yml file
but realize that basically this means you are saying:
Copy code
Ingest a bunch of metadata about datasets, and remove them from UI, search, etc.
I'm trying to understand what is your use-case for doing this
h
Facing the same issue with - "set_dataset_browse_path" transformers: - type: "set_dataset_browse_path" config: path_templates: - /ENV/PLATFORM/DATASET_PARTS/
There is no use case as such, I was trying out the transformer options available for use.
m
ok got it! I think the reason you are not finding these transformers is because we haven't packaged them in a release yet
they are available on the source repo and can be used if you install the python package locally
h
Got it.
m
As it happens we just released 0.8.8.2 pypi package, so you should be able to get this now if you 
pip install -U acryl_datahub
👍 1
5 Views
Open in Slack
PreviousNext
Powered by