https://linen.dev logo
Join Slack
Powered by
This message was deleted.
# troubleshooting
s
This message was deleted.
a
Yes you also need to include the 
type
. Now sure what kind of DSL you are using there but I would expect adding something like:
Copy code
druid_auth_authenticator_basic_authorizerType: 'basic',
should fix that error.
j
Thanks, will try that. Didn't see that option
s
This is our working configuration druid.auth.authenticatorChain=["MyBasicPostgreSQLAuthenticator"] druid.auth.authenticator.MyBasicPostgreSQLAuthenticator.type=basic druid.auth.authenticator.MyBasicPostgreSQLAuthenticator.initialAdminPassword=<ADmin Password> druid.auth.authenticator.MyBasicPostgreSQLAuthenticator.initialInternalClientPassword= <Client password> druid.auth.authenticator.MyBasicPostgreSQLAuthenticator.credentialsValidator.type=metadata druid.auth.authenticator.MyBasicPostgreSQLAuthenticator.skipOnFailure=false druid.auth.authenticator.MyBasicPostgreSQLAuthenticator.authorizerName=MyBasicPostgreSQLAuthorizer # Escalator druid.escalator.type=basic druid.escalator.internalClientUsername=druid_system druid.escalator.internalClientPassword=<Client Passowrd> druid.escalator.authorizerName=MyBasicPostgreSQLAuthorizer druid.auth.authorizers=["MyBasicPostgreSQLAuthorizer"] druid.auth.authorizer.MyBasicPostgreSQLAuthorizer.type=basic
j
added missing conf but getting same error:
Copy code
druid_auth_authenticator_basic_authorizerName: 'basic',                  druid_auth_authenticator_basic_authorizerType: 'basic',                  druid_auth_authenticatorChain: '["basic"]',
Copy code
2022-09-25T18:46:30,681 INFO [main] org.eclipse.jetty.util.log - Logging initialized @7259ms to org.eclipse.jetty.util.log.Slf4jLog
2022-09-25T18:46:30,718 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Creating http connector with port [8083]
2022-09-25T18:46:30,958 ERROR [main] org.apache.druid.cli.CliHistorical - Error when starting up.  Failing.
com.google.inject.ProvisionException: Unable to provision, see the following errors:

1) Error in custom provider, <http://org.apache.druid.java.util.common.RE|org.apache.druid.java.util.common.RE>: server initialization exception
  at org.apache.druid.server.initialization.jetty.JettyServerModule.getServer(JettyServerModule.java:177) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> org.apache.druid.server.initialization.jetty.JettyServerModule)
  at org.apache.druid.server.initialization.jetty.JettyServerModule.getServer(JettyServerModule.java:177) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> org.apache.druid.server.initialization.jetty.JettyServerModule)
  while locating org.eclipse.jetty.server.Server

1 error
    at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1028) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1050) ~[guice-4.1.0.jar:?]
    at org.apache.druid.guice.LifecycleModule$2.start(LifecycleModule.java:150) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:136) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:94) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.ServerRunnable.run(ServerRunnable.java:63) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.Main.main(Main.java:112) ~[druid-services-24.0.0.jar:24.0.0]
Caused by: <http://org.apache.druid.java.util.common.RE|org.apache.druid.java.util.common.RE>: server initialization exception
    at org.apache.druid.server.initialization.jetty.JettyServerModule.makeAndInitializeServer(JettyServerModule.java:420) ~[druid-server-24.0.0.jar:24.0.0]
    at org.apache.druid.server.initialization.jetty.JettyServerModule.getServer(JettyServerModule.java:177) ~[druid-server-24.0.0.jar:24.0.0]
    at org.apache.druid.server.initialization.jetty.JettyServerModule$$FastClassByGuice$$ff9924d8.invoke(<generated>) ~[druid-server-24.0.0.jar:24.0.0]
    at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:264) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderMethod$Factory.provision(ProviderMethod.java:401) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderMethod$Factory.get(ProviderMethod.java:376) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) ~[guice-4.1.0.jar:?]
    ... 6 more
Caused by: com.google.inject.ProvisionException: Unable to provision, see the following errors:

1) Problem parsing object at prefix[druid.auth.authenticator.basic]: Missing type id when trying to resolve subtype of [simple type, class org.apache.druid.server.security.Authenticator]: missing type id property 'type'
 at [Source: UNKNOWN; line: -1, column: -1].
  at org.apache.druid.server.initialization.AuthenticatorMapperModule.configure(AuthenticatorMapperModule.java:54) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> org.apache.druid.server.initialization.AuthenticatorMapperModule)
  at org.apache.druid.server.initialization.AuthenticatorMapperModule.configure(AuthenticatorMapperModule.java:54) (via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule -> org.apache.druid.server.initialization.AuthenticatorMapperModule)
  while locating org.apache.druid.server.security.AuthenticatorMapper

1 error
    at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1028) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1054) ~[guice-4.1.0.jar:?]
    at org.apache.druid.cli.QueryJettyServerInitializer.initialize(QueryJettyServerInitializer.java:99) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.server.initialization.jetty.JettyServerModule.makeAndInitializeServer(JettyServerModule.java:417) ~[druid-server-24.0.0.jar:24.0.0]
    at org.apache.druid.server.initialization.jetty.JettyServerModule.getServer(JettyServerModule.java:177) ~[druid-server-24.0.0.jar:24.0.0]
    at org.apache.druid.server.initialization.jetty.JettyServerModule$$FastClassByGuice$$ff9924d8.invoke(<generated>) ~[druid-server-24.0.0.jar:24.0.0]
    at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:264) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderMethod$Factory.provision(ProviderMethod.java:401) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderMethod$Factory.get(ProviderMethod.java:376) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:194) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) ~[guice-4.1.0.jar:?]
    at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) ~[guice-4.1.0.jar:?]
    ... 6 more
Caused by: java.lang.IllegalArgumentException: Missing type id when trying to resolve subtype of [simple type, class org.apache.druid.server.security.Authenticator]: missing type id property 'type'
 at [Source: UNKNOWN; line: -1, column: -1]
d
Show us the final config that was generated in the pod.
j
configmap of cluster
Copy code
apiVersion: v1
data:
  DRUID_LOG4J: <?xml version="1.0" encoding="UTF-8" ?><Configuration status="WARN"><Appenders><Console
    name="Console" target="SYSTEM_OUT"><PatternLayout pattern="%d{ISO8601} %p [%t]
    %c - %m%n"/></Console></Appenders><Loggers><Root level="info"><AppenderRef ref="Console"/></Root><Logger
    name="org.apache.druid.jetty.RequestLog" additivity="false" level="DEBUG"><AppenderRef
    ref="Console"/></Logger></Loggers></Configuration>
  DRUID_USE_CONTAINER_IP: "true"
  druid_auth_authenticator_basic_authorizerName: basic
  druid_auth_authenticator_basic_authorizerType: basic
  druid_auth_authenticator_basic_initialAdminPassword: 1234
  druid_auth_authenticator_basic_type: basic
  druid_auth_authenticatorChain: '["basic"]'
  druid_auth_authorizer_basic_type: basic
  druid_auth_authorizers: '["basic"]'
  druid_emitter: statsd
  druid_emitter_http_recipientBaseUrl: <http://druid_exporter_url>:druid_exporter_port/druid
  druid_emitter_logging_logLevel: debug
  druid_emitter_statsd_dogstatsd: "true"
  druid_emitter_statsd_dogstatsdConstantTags: '["cluster:cluster-test"]'
  druid_emitter_statsd_hostname: 10.3.111.222
  druid_emitter_statsd_includeHost: "true"
  druid_emitter_statsd_port: "8125"
  druid_extensions_directory: /opt/druid/extensions
  druid_extensions_hadoopDependenciesDir: /opt/druid/hadoop-dependencies
  druid_extensions_loadList: '["druid-histogram","druid-datasketches","postgresql-metadata-storage","druid-kinesis-indexing-service","druid-parquet-extensions","druid-basic-security","druid-s3-extensions","druid-kafka-indexing-service","statsd-emitter","druid-avro-extensions","druid-lookups-cached-global"]'
  druid_global_http_requestBuffersize: "16384"
  druid_indexer_logs_directory: /opt/data/indexing-logs
  druid_indexer_logs_disableAcl: "true"
  druid_indexer_logs_s3Bucket: druid-indexing-metadata-dev
  druid_indexer_logs_s3Prefix: druid/indexing-logs
  druid_indexer_logs_type: s3
  druid_indexer_task_baseDir: /opt/druid/var/tmp/
  druid_metadata_storage_connector_connectURI: jdbc:<postgresql://druid-metadata-storage-test.c12rj4a7dt4u.us-east-2.rds.amazonaws.com:5432/druid?autoReconnect=true>
  druid_metadata_storage_connector_password: 4321
  druid_metadata_storage_connector_user: druid
  druid_metadata_storage_type: postgresql
  druid_monitoring_emissionPeriod: PT15S
  druid_selectors_coordinator_serviceName: druid/coordinator
  druid_selectors_indexing_serviceName: druid/overlord
  druid_server_http_maxRequestHeaderSize: "16384"
  druid_startup_logging_logProperties: "true"
  druid_storage_baseKey: druid/segments
  druid_storage_bucket: druid-indexing-metadata-test
  druid_storage_disableAcl: "true"
  druid_storage_type: s3
  druid_zk_service_host: druid-cluster-test-zookeeper-headless:2181
  druid_zk_service_terminateDruidProcessOnConnectFail: "true"
new error I got with above:
Copy code
2022-09-26T09:44:07,609 WARN [main] org.apache.druid.java.util.common.RetryUtils - Retrying (1 of 9) in 1,528ms.
com.fasterxml.jackson.core.JsonParseException: Input does not start with Smile format header (first byte = 0x7b) -- rather, it starts with '{' (plain JSON input?) -- can not parse
 at [Source: (byte[])"{"error":"Unauthorized request","errorMessage":null,"errorClass":null,"host":"druid-cluster-test-coordinator-767dfd47b6-bwdxn"}"; line: -1, column: 0]
    at com.fasterxml.jackson.dataformat.smile.SmileParserBootstrapper.constructParser(SmileParserBootstrapper.java:133) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory._createParser(SmileFactory.java:460) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:366) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:353) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:29) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3292) ~[jackson-databind-2.10.5.1.jar:2.10.5.1]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.tryFetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:262) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.lambda$fetchUserMapFromCoordinator$1(CoordinatorPollingBasicAuthenticatorCacheManager.java:192) ~[?:?]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:129) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:81) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:163) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:153) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.fetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:190) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.initUserMaps(CoordinatorPollingBasicAuthenticatorCacheManager.java:289) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.start(CoordinatorPollingBasicAuthenticatorCacheManager.java:108) ~[?:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_275]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_275]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_275]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_275]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:446) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle.start(Lifecycle.java:341) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.guice.LifecycleModule$2.start(LifecycleModule.java:152) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:136) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:94) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.ServerRunnable.run(ServerRunnable.java:63) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.Main.main(Main.java:112) ~[druid-services-24.0.0.jar:24.0.0]
2022-09-26T09:44:09,146 WARN [main] org.apache.druid.java.util.common.RetryUtils - Retrying (2 of 9) in 1,203ms.
com.fasterxml.jackson.core.JsonParseException: Input does not start with Smile format header (first byte = 0x7b) -- rather, it starts with '{' (plain JSON input?) -- can not parse
 at [Source: (byte[])"{"error":"Unauthorized request","errorMessage":null,"errorClass":null,"host":"druid-cluster-test-coordinator-767dfd47b6-bwdxn"}"; line: -1, column: 0]
    at com.fasterxml.jackson.dataformat.smile.SmileParserBootstrapper.constructParser(SmileParserBootstrapper.java:133) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory._createParser(SmileFactory.java:460) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:366) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:353) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:29) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3292) ~[jackson-databind-2.10.5.1.jar:2.10.5.1]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.tryFetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:262) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.lambda$fetchUserMapFromCoordinator$1(CoordinatorPollingBasicAuthenticatorCacheManager.java:192) ~[?:?]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:129) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:81) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:163) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:153) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.fetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:190) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.initUserMaps(CoordinatorPollingBasicAuthenticatorCacheManager.java:289) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.start(CoordinatorPollingBasicAuthenticatorCacheManager.java:108) ~[?:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_275]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_275]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_275]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_275]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:446) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle.start(Lifecycle.java:341) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.guice.LifecycleModule$2.start(LifecycleModule.java:152) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:136) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:94) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.ServerRunnable.run(ServerRunnable.java:63) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.Main.main(Main.java:112) ~[druid-services-24.0.0.jar:24.0.0]
2022-09-26T09:44:09,396 INFO [NodeRoleWatcher[COORDINATOR]] org.apache.druid.discovery.BaseNodeRoleWatcher - Node [<http://10.3.105.8:8081>] of role [coordinator] detected.
2022-09-26T09:44:10,353 WARN [main] org.apache.druid.java.util.common.RetryUtils - Retrying (3 of 9) in 4,230ms.
com.fasterxml.jackson.core.JsonParseException: Input does not start with Smile format header (first byte = 0x7b) -- rather, it starts with '{' (plain JSON input?) -- can not parse
 at [Source: (byte[])"{"error":"Unauthorized request","errorMessage":null,"errorClass":null,"host":"druid-cluster-test-coordinator-767dfd47b6-bwdxn"}"; line: -1, column: 0]
    at com.fasterxml.jackson.dataformat.smile.SmileParserBootstrapper.constructParser(SmileParserBootstrapper.java:133) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory._createParser(SmileFactory.java:460) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:366) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:353) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:29) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3292) ~[jackson-databind-2.10.5.1.jar:2.10.5.1]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.tryFetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:262) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.lambda$fetchUserMapFromCoordinator$1(CoordinatorPollingBasicAuthenticatorCacheManager.java:192) ~[?:?]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:129) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:81) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:163) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:153) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.fetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:190) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.initUserMaps(CoordinatorPollingBasicAuthenticatorCacheManager.java:289) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.start(CoordinatorPollingBasicAuthenticatorCacheManager.java:108) ~[?:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_275]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_275]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_275]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_275]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:446) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle.start(Lifecycle.java:341) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.guice.LifecycleModule$2.start(LifecycleModule.java:152) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:136) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:94) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.ServerRunnable.run(ServerRunnable.java:63) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.Main.main(Main.java:112) ~[druid-services-24.0.0.jar:24.0.0]
am I missing also following conf?
Copy code
druid_auth_authenticator_basic_initialInternalClientPassword=1234
druid_escalator_authorizerName=basic
druid_escalator_internalClientPassword=1234
druid_escalator_internalClientUsername=druid_system
druid_escalator_type=basic
changed config to
Copy code
apiVersion: v1
data:
  DRUID_LOG4J: <?xml version="1.0" encoding="UTF-8" ?><Configuration status="WARN"><Appenders><Console
    name="Console" target="SYSTEM_OUT"><PatternLayout pattern="%d{ISO8601} %p [%t]
    %c - %m%n"/></Console></Appenders><Loggers><Root level="info"><AppenderRef ref="Console"/></Root><Logger
    name="org.apache.druid.jetty.RequestLog" additivity="false" level="DEBUG"><AppenderRef
    ref="Console"/></Logger></Loggers></Configuration>
  DRUID_USE_CONTAINER_IP: "true"
  druid_auth_authenticator_MyBasicMetadataAuthenticator_authorizerName: MyBasicMetadataAuthenticator
  druid_auth_authenticator_MyBasicMetadataAuthenticator_authorizerType: basic
  druid_auth_authenticator_MyBasicMetadataAuthenticator_credentialsValidator_type: metadata
  druid_auth_authenticator_MyBasicMetadataAuthenticator_initialAdminPassword: 1234
  druid_auth_authenticator_MyBasicMetadataAuthenticator_skipOnFailure: "false"
  druid_auth_authenticator_MyBasicMetadataAuthenticator_type: basic
  druid_auth_authenticator_basic_initialInternalClientPassword: 4321
  druid_auth_authenticatorChain: '["MyBasicMetadataAuthenticator"]'
  druid_auth_authorizer_MyBasicMetadataAuthenticator_type: basic
  druid_auth_authorizers: '["MyBasicMetadataAuthenticator"]'
  druid_emitter: statsd
  druid_emitter_http_recipientBaseUrl: <http://druid_exporter_url>:druid_exporter_port/druid
  druid_emitter_logging_logLevel: debug
  druid_emitter_statsd_dogstatsd: "true"
  druid_emitter_statsd_dogstatsdConstantTags: '["cluster:cluster-test"]'
  druid_emitter_statsd_hostname: 10.3.153.124
  druid_emitter_statsd_includeHost: "true"
  druid_emitter_statsd_port: "8125"
  druid_escalator_authorizerName: MyBasicMetadataAuthenticator
  druid_escalator_internalClientPassword: 1234
  druid_escalator_internalClientUsername: druid_system
  druid_escalator_type: basic
  druid_extensions_directory: /opt/druid/extensions
  druid_extensions_hadoopDependenciesDir: /opt/druid/hadoop-dependencies
  druid_extensions_loadList: '["druid-histogram","druid-datasketches","postgresql-metadata-storage","druid-kinesis-indexing-service","druid-parquet-extensions","druid-basic-security","druid-s3-extensions","druid-kafka-indexing-service","statsd-emitter","druid-avro-extensions","druid-lookups-cached-global"]'
  druid_global_http_requestBuffersize: "16384"
  druid_indexer_logs_directory: /opt/data/indexing-logs
  druid_indexer_logs_disableAcl: "true"
  druid_indexer_logs_s3Bucket: druid-indexing-metadata-test
  druid_indexer_logs_s3Prefix: druid/indexing-logs
  druid_indexer_logs_type: s3
  druid_indexer_task_baseDir: /opt/druid/var/tmp/
  druid_metadata_storage_connector_connectURI: jdbc:<postgresql://druid-metadata-storage-test.abcd.us-west-1.rds.amazonaws.com:5432/druid?autoReconnect=true>
  druid_metadata_storage_connector_password: 4321
  druid_metadata_storage_connector_user: druid
  druid_metadata_storage_type: postgresql
  druid_monitoring_emissionPeriod: PT15S
  druid_monitoring_monitors: '["org.apache.druid.java.util.metrics.JvmMonitor"]'
  druid_selectors_coordinator_serviceName: druid/coordinator
  druid_selectors_indexing_serviceName: druid/overlord
  druid_server_http_maxRequestHeaderSize: "16384"
  druid_startup_logging_logProperties: "true"
  druid_storage_baseKey: druid/segments
  druid_storage_bucket: druid-indexing-metadata-test
  druid_storage_disableAcl: "true"
  druid_storage_type: s3
  druid_zk_service_host: druid-cluster-test-zookeeper-headless:2181
  druid_zk_service_terminateDruidProcessOnConnectFail: "true"
kind: ConfigMap
but getting
Copy code
2022-09-26T14:03:20,344 WARN [main] org.apache.druid.java.util.common.RetryUtils - Retrying (3 of 9) in 4,526ms.
com.fasterxml.jackson.core.JsonParseException: Input does not start with Smile format header (first byte = 0x3c) and parser has REQUIRE_HEADER enabled: can not parse
 at [Source: (byte[])"<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 401 Unauthorized</title>
</head>
<body><h2>HTTP ERROR 401 Unauthorized</h2>
<table>
<tr><th>URI:</th><td>/druid-ext/basic-security/authentication/db/MyBasicMetadataAuthenticator/cachedSerializedUserMap</td></tr>
<tr><th>STATUS:</th><td>401</td></tr>
<tr><th>MESSAGE:</th><td>Unauthorized</td></tr>
<tr><th>SERVLET:</th><td>default</td></tr>
</table>

</body>
</html>
"; line: -1, column: 0]
    at com.fasterxml.jackson.dataformat.smile.SmileParserBootstrapper.constructParser(SmileParserBootstrapper.java:133) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory._createParser(SmileFactory.java:460) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:366) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:353) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.dataformat.smile.SmileFactory.createParser(SmileFactory.java:29) ~[jackson-dataformat-smile-2.10.5.jar:2.10.5]
    at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3292) ~[jackson-databind-2.10.5.1.jar:2.10.5.1]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.tryFetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:262) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.lambda$fetchUserMapFromCoordinator$1(CoordinatorPollingBasicAuthenticatorCacheManager.java:192) ~[?:?]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:129) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:81) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:163) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:153) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.fetchUserMapFromCoordinator(CoordinatorPollingBasicAuthenticatorCacheManager.java:190) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.initUserMaps(CoordinatorPollingBasicAuthenticatorCacheManager.java:289) ~[?:?]
    at org.apache.druid.security.basic.authentication.db.cache.CoordinatorPollingBasicAuthenticatorCacheManager.start(CoordinatorPollingBasicAuthenticatorCacheManager.java:108) ~[?:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_275]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_275]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_275]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_275]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:446) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.java.util.common.lifecycle.Lifecycle.start(Lifecycle.java:341) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.guice.LifecycleModule$2.start(LifecycleModule.java:152) ~[druid-core-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:136) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:94) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.ServerRunnable.run(ServerRunnable.java:63) ~[druid-services-24.0.0.jar:24.0.0]
    at org.apache.druid.cli.Main.main(Main.java:112) ~[druid-services-24.0.0.jar:24.0.0]
not sure what I am doing wrong here
looks like I got it working with following config
Copy code
druid_auth_authenticator_MyBasicMetadataAuthenticator_authorizerName: MyBasicMetadataAuthorizer
  druid_auth_authenticator_MyBasicMetadataAuthenticator_authorizerType: basic
  druid_auth_authenticator_MyBasicMetadataAuthenticator_initialAdminPassword: 1234
  druid_auth_authenticator_MyBasicMetadataAuthenticator_initialInternalClientPassword: 1234
  druid_auth_authenticator_MyBasicMetadataAuthenticator_skipOnFailure: "false"
  druid_auth_authenticator_MyBasicMetadataAuthenticator_type: basic
  druid_auth_authenticatorChain: '["MyBasicMetadataAuthenticator"]'
  druid_auth_authorizer_MyBasicMetadataAuthorizer_type: basic
  druid_auth_authorizers: '["MyBasicMetadataAuthorizer"]'
  druid_escalator_authorizerName: MyBasicMetadataAuthorizer
  druid_escalator_internalClientPassword: 1234
  druid_escalator_internalClientUsername: druid_system
  druid_escalator_type: basic
7 Views
Open in Slack
PreviousNext
Powered by