Hello everyone, I wanted to ingest some data, but...
# troubleshoot
b
Hello everyone, I wanted to ingest some data, but elasticsearch is logging some kind of error and nothing can be uploaded to datahub. When ignestion happens i get the info that records and urns were created/written but when accessing datahub page I see nothing. I am pasting below the error from datahub-gms logs Thank you deeply for the help
Copy code
12:13:42.624 [I/O dispatcher 1] ERROR c.l.m.s.e.update.BulkListener:25 - Failed to feed bulk request. Number of events: 18 Took time ms: -1 Message: failure in bulk execution:
[0]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeLog_Timeseries_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[1]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeLog_Timeseries_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[2]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataAuditEvent_v4%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[3]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataAuditEvent_v4%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[4]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeEvent_v4%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[5]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeEvent_v4%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[6]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeProposal_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[7]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeProposal_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[8]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.FailedMetadataChangeEvent_v4%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[9]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.FailedMetadataChangeEvent_v4%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[10]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.PlatformEvent_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[11]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.PlatformEvent_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[12]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.FailedMetadataChangeProposal_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[13]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.FailedMetadataChangeProposal_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[14]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeLog_Versioned_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[15]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.MetadataChangeLog_Versioned_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[16]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.DataHubUsageEvent_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
[17]: index [datasetindex_v2], type [_doc], id [urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Akafka%2C0.DataHubUsageEvent_v1%2CPROD%29], message [ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=index [datasetindex_v2] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark, index has read-only-allow-delete block];]]]
b
Deploying Datahub using Quickstart?
b
@better-orange-49102 - yes, and to be more precise: datahub docker quickstart --quickstart-compose-file quickstart/docker-compose-without-neo4j.quickstart.yml
b
Try doing a docker system prune while datahub is running to clear unnecc images
b
it worked, thanks!