hey everyone - potentially a dumb question.. whats...
# troubleshoot
a
hey everyone - potentially a dumb question.. whats the best way to set the logging levels in the ui and gms containers? I’d like to be able to set the level to debug
b
Not a dumb question. Currently we don't expose a way to do it like on deploy of the container. That being said, we do save a standard info, error, warn log to a local directory when running along with a DEBUG-only log file kept for the last 24 hours
a
ah cool. thanks! I’ll try ssh into the pod. I’m seeing some weird configuration error where data looks like its ingested properly but won’t show up in the UI.
Most likely associated with quirk in teh way we’ve set things up
b
Oh interesting -- are they showing up when you query for them directly?
a
I can see the results in MySQL (metadata_aspect_v2 table), just trying to get access to elastic now (I’m restricted in that namespace). The GMS logs all look healthy
it could be a kafka thing too because of teh ACLs applied, just trying to debug which queries are being fired. Weirdly teh analytics queries return results
b
Oh well that means you're talking to elastic
a
yeah, this is an odd one! we’ve probably done something strange
hmm. this is odd.
datasetindex_v2
is empty, but there is data in the mysql
metadata_aspect_v2
table. The GMS service looks like its happily ingesting everything, any ideas?
(there doesn’t appear to be anything in neo4j either)
b
Hmmm it. It could be that your MAE consumer is not running. How are you deploying this?
a
Deployment through a helm chart, running version V0.8.10, I’ve just checked and we dont actually have an MAE consumer running. I’ve just been using a GMS pod and hitting the restful endpoint
at the moment my best guess is that there is something odd going on with the kafka schema registry, and we’re not passing through the correct security configuration. Should all the topics we create be registered with the schema registry?
Copy code
org.apache.kafka.common.errors.GroupAuthorizationException: Not authorized to access group: generic-mce-consumer-job-client
07:11:51.745 [generic-mce-consumer-job-client-0-C-1] ERROR o.s.k.l.KafkaMessageListenerContainer$ListenerConsumer - Fatal consumer exception; stopping container
hmmm.. just spotted this in our logs. Should that actually kill the container?
b
Yes it should kill the container since kafka is mission critical :(
a
I think what happens in our case is that the producers subscribe but we've set up the security layer for Kafka incorrectly within the pod for the consumer, so we end up in an odd state where the restapi received the data and then can't do anything with it
b
That sounds about right
r
HI @adamant-pharmacist-61996 How did you manage to solve this issue?
Copy code
org.apache.kafka.common.errors.GroupAuthorizationException: Not authorized to access group: generic-mce-consumer-job-client
07:11:51.745 [generic-mce-consumer-job-client-0-C-1] ERROR o.s.k.l.KafkaMessageListenerContainer$ListenerConsumer - Fatal consumer exception; stopping container