Hi community, As you know from my previous post i...
# troubleshoot
g
Hi community, As you know from my previous post i were able to connect to external ElasticSearch, provide ability to create indices. We created manually templates and policies to fit our security requirements. And here is the point i`m not able to find where the application is creating data streams. Can someone post me place where is the function/classes responsible for data stream creation/ Unfortunately i`m getting following error:
Copy code
datahub-gms               |     Suppressed: org.elasticsearch.client.ResponseException: method [POST], host [<https://some.server.eu:11920>], URI [/datahub_usage_event/_search?typed_keys=true&max_concurrent_shard_requests=5&ignore_unavailable=false&expand_wildc
ards=open&allow_no_indices=true&ignore_throttled=true&search_type=query_then_fetch&batched_reduce_size=512&ccs_minimize_roundtrips=true], status line [HTTP/1.1 400 Bad Request]
datahub-gms               | Warnings: [[ignore_throttled] parameter is deprecated because frozen indices have been deprecated. Consider cold or frozen tiers in place of frozen indices.]
datahub-gms               | {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Text fields are not optimised for operations that require per-document field data like aggregations and sorting, so these operations are disabled by default. Please use a ke
yword field instead. Alternatively, set fielddata=true on [browserId] in order to load field data by uninverting the inverted index. Note that this can use significant memory."}],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","group
ed":true,"failed_shards":[{"shard":0,"index":"datahub_usage_event","node":"xn4qYxnUQh6UvcZIJ0AGSQ","reason":{"type":"illegal_argument_exception","reason":"Text fields are not optimised for operations that require per-document field data like aggregations and sorting, so t
In the logs i`m not seeing anything related to the PUT method to create datahub_usage_event stream propperly All other creation of the index is made successful I was looking as well for this https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/elastic_search.py But here methods are more rather then for get some specific datastreams staff Any idea, suggestion ?