Hi, has anyone seen this error before? ```ERROR ...
# troubleshoot
s
Hi, has anyone seen this error before?
Copy code
ERROR    {datahub_actions.plugin.source.kafka.kafka_event_source:157} - Kafka consume error: KafkaError{code=_NOT_IMPLEMENTED,val=-170,str="Decompression (codec 0x4) of message at 110 of 186 bytes failed: Local: Not implemented"}
Seeing this mainly in my
datahub-acryl-datahub-actions
pod
🔍 1
âś… 1
đź“– 1
l
This content can't be displayed.
a
@brainy-tent-14503 might be able to speak to this
s
@brainy-tent-14503 on my current kafka cluster it has ztsd compression
Using Datahub version 10.1 EKS deploy
@brainy-tent-14503 @dazzling-yak-93039 Any thoughts here? ^
@astonishing-answer-96712 Which component is responsible for producing messages into kafka?
b
The datahub topics do not contained compressed messages usually. If something in your environment is introducing zstd compression, then the error means that the zstd compression libraries are not present in your actions pod image. We may add support for compressed messages in the future, however in order to do so today with zstd, you’d have to add the zstd libraries to the actions docker container.
s
No worries! Thank you David, I changed the topic config to be uncompressed since then I haven’t seen any errors in the pod
@brainy-tent-14503 so i was able to get rid of that kafka error code but changing the topics config to
uncompressed
, just wanted to see if this is in an error state or if this is completely fine
Copy code
❯ kubectl logs pod/datahub-acryl-datahub-actions-ff649f764-d4qs2 -c acryl-datahub-actions
2023/04/19 22:17:12 Waiting for: http://datahub-datahub-gms:8080/health
2023/04/19 22:17:12 Received 200 from http://datahub-datahub-gms:8080/health
No user action configurations found. Not starting user actions.
[2023-04-19 22:17:13,541] INFO     {datahub_actions.cli.actions:76} - DataHub Actions version: unavailable (installed editable via git)
[2023-04-19 22:17:14,361] WARNING  {datahub_actions.cli.actions:103} - Skipping pipeline datahub_slack_action as it is not enabled
[2023-04-19 22:17:14,364] WARNING  {datahub_actions.cli.actions:103} - Skipping pipeline datahub_teams_action as it is not enabled
[2023-04-19 22:17:14,365] INFO     {datahub_actions.cli.actions:119} - Action Pipeline with name 'ingestion_executor' is now running.
a
That looks normal when there is no configured notification channels. This looks like a typical idle state to me.