Also the acryl-actions container is yelling about ...
# all-things-deploymente
elegant-traffic-96321
03/03/2022, 10:03 PMAlso the acryl-actions container is yelling about the schema_registry_url. It seems it requires a kafka schema registry url, but we’re using MSK and glue as supported by this doc here: https://datahubproject.io/docs/deploy/aws/
elegant-traffic-96321
03/03/2022, 10:05 PMerror is this:
Copy code
ValueDeserializationError: KafkaError{code=_VALUE_DESERIALIZATION,val=-159,str="Unknown magic byte. This message was not produced with a Confluent Schema Registry serializer"}e
early-lamp-41924
03/03/2022, 10:13 PMUnfortunately, AWS Glue does not have a python SDK, which makes it impossible to use with our python libraries like ingestion or acryl-actions. Created PR to add a warning on this. https://github.com/linkedin/datahub/pull/4306 Sorry about that
e
elegant-traffic-96321
03/03/2022, 10:14 PMshould we just not run the container?
e
early-lamp-41924
03/03/2022, 11:14 PMYes! You can turn off managed_ingestion https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/values.yaml#L159 and datahub-actinos https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/values.yaml#L19
👍 1
e
elegant-traffic-96321
03/04/2022, 7:41 PM@early-lamp-41924 we seem to still be able to set up ingestion pipelines in the UI even though we have UI_INGESTION disabled. Is the actions container actually in charge of ingestion?
b
big-carpet-38439
03/04/2022, 10:11 PMSo you still see the tab you mean?
big-carpet-38439
03/04/2022, 10:11 PMDo you want to hide that tab? If so there should be a way
2 Views