ES ingestion fails with error "Missing Fields in elasticsearch mappings". Is there a way in cli to ignore the errors and ingest the metdata. In our setup we have few thousand indices and adding them to the ignore list would require running the datahub cli multiple times and updating the yml. This leads to a lot of rework.

Can you give a bit more context about exactly what error is happening? Is DataHub trying to ingest into other indices on your cluster?

No i am using datahub cli to ingest ES metadata into datahub. The datahub cli fails with error "Missing Fields in elasticsearch mappings"

Does it give you the index name in the error? This sounds like there was an issue with the elasticsearch-setup job where one or more indices were not generated properly. Are you using the latest version for both the CLI and server?

Let me phrase the question again. I am ingesting ES metadata from one of our ES instance into datahub. The datahub CLI randomly errors out for certain indexes with error "Missing Fields in elasticsearch mappings". Yes the index name is reported in the error logs but adding the index name to the YAML ignore list is a manual task. Is there a way to jus ignore errors and ingest. CLI should report the errors and ingest the indexes for which there are no errors.