https://datahubproject.io logo
Join Slack
Powered by
hi! I have just updated from 0.8.34 to 0.8.36 and ...
# all-things-deployment
n
hi! I have just updated from 0.8.34 to 0.8.36 and the login is broken
Copy code
12:00:23 [application-akka.actor.default-dispatcher-11] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
12:00:23 [application-akka.actor.default-dispatcher-11] WARN  application - The submitted callback is unsupported!
12:00:23 [application-akka.actor.default-dispatcher-11] WARN  application - The submitted callback is unsupported!
12:00:23 [application-akka.actor.default-dispatcher-11] ERROR application -

! @7np13m5bo - Internal server error, for (POST) [/logIn] ->

play.api.UnexpectedException: Unexpected exception[RuntimeException: Failed to generate session token for user]
	at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:247)
	at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:176)
	at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:363)
	at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:361)
	at scala.concurrent.Future$$anonfun$recoverWith$1.apply(Future.scala:346)
	at scala.concurrent.Future$$anonfun$recoverWith$1.apply(Future.scala:345)
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
	at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:92)
	at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:92)
	at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:92)
	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)
	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:91)
	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:49)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.lang.RuntimeException: Failed to generate session token for user
	at client.AuthServiceClient.generateSessionTokenForUser(AuthServiceClient.java:80)
	at controllers.AuthenticationController.logIn(AuthenticationController.java:141)
	at router.Routes$$anonfun$routes$1$$anonfun$applyOrElse$5$$anonfun$apply$5.apply(Routes.scala:456)
	at router.Routes$$anonfun$routes$1$$anonfun$applyOrElse$5$$anonfun$apply$5.apply(Routes.scala:456)
	at play.core.routing.HandlerInvokerFactory$$anon$3.resultCall(HandlerInvoker.scala:134)
	at play.core.routing.HandlerInvokerFactory$$anon$3.resultCall(HandlerInvoker.scala:133)
	at play.core.routing.HandlerInvokerFactory$JavaActionInvokerFactory$$anon$8$$anon$2$$anon$1.invocation(HandlerInvoker.scala:108)
	at play.core.j.JavaAction$$anon$1.call(JavaAction.scala:88)
	at play.http.DefaultActionCreator$1.call(DefaultActionCreator.java:31)
	at play.core.j.JavaAction$$anonfun$9.apply(JavaAction.scala:138)
	at play.core.j.JavaAction$$anonfun$9.apply(JavaAction.scala:138)
	at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
	at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
	at play.core.j.HttpExecutionContext$$anon$2.run(HttpExecutionContext.scala:56)
	at play.api.libs.streams.Execution$trampoline$.execute(Execution.scala:70)
	at play.core.j.HttpExecutionContext.execute(HttpExecutionContext.scala:48)
	at scala.concurrent.impl.Future$.apply(Future.scala:31)
	at scala.concurrent.Future$.apply(Future.scala:494)
	at play.core.j.JavaAction.apply(JavaAction.scala:138)
	at play.api.mvc.Action$$anonfun$apply$2.apply(Action.scala:96)
	at play.api.mvc.Action$$anonfun$apply$2.apply(Action.scala:89)
	at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:253)
	at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:251)
	... 13 common frames omitted
Caused by: java.lang.RuntimeException: Bad response from the Metadata Service: HTTP/1.1 404 Not Found ResponseEntityProxy{[Content-Length: 6739,Chunked: false]}
	at client.AuthServiceClient.generateSessionTokenForUser(AuthServiceClient.java:76)
	... 35 common frames omitted
any clue? 😞
b
Processing...Processing..Processing
n
what do you mean?
b
I'm processing your message
n
oh ok
b
@incalculable-ocean-74010 could this be related to new access tokens?
@numerous-camera-74294 I have a suspicion - can you confirm that both your datahub-frontend-react AND datahub-gms containers have been upgraded to 0.8.36?
This seems like it could be a synchronization issue
n
yes!
should I do it in a specific ordeR?
b
No that shouldn't be necessary
Let me keep looking
n
kk
i
@numerous-camera-74294 could you share a few lines from the logs just above and below this exception trace?
Also, is this DataHub deployed in k8s?
b
Yeah this one is quite strange. The fact that GMS is returning 404 is suggesting that the resource just was not found..
And from my reading, nothing has changed about the presence of this endpoint
n
@incalculable-ocean-74010
Copy code
09:54:20 [application-akka.actor.default-dispatcher-10] INFO  o.a.kafka.common.utils.AppInfoParser - Kafka version: 2.3.0
09:54:20 [application-akka.actor.default-dispatcher-10] INFO  o.a.kafka.common.utils.AppInfoParser - Kafka commitId: fc1aaa116b661c8a
09:54:20 [application-akka.actor.default-dispatcher-10] INFO  o.a.kafka.common.utils.AppInfoParser - Kafka startTimeMs: 1654250060176
09:54:20 [kafka-producer-network-thread | datahub-frontend] INFO  org.apache.kafka.clients.Metadata - [Producer clientId=datahub-frontend] Cluster ID: kuJvpkgySFuH6dDd8SsgVQ
09:55:57 [application-akka.actor.default-dispatcher-6] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:55:58 [application-akka.actor.default-dispatcher-138] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:55:58 [application-akka.actor.default-dispatcher-6] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:55:58 [application-akka.actor.default-dispatcher-10] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:55:58 [application-akka.actor.default-dispatcher-198] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:55:59 [application-akka.actor.default-dispatcher-198] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:56:02 [application-akka.actor.default-dispatcher-198] WARN  p.api.mvc.LegacySessionCookieBaker - Cookie failed message authentication check
09:56:02 [application-akka.actor.default-dispatcher-198] INFO  org.eclipse.jetty.util.log - Logging initialized @192378ms to org.eclipse.jetty.util.log.Slf4jLog
09:56:02 [application-akka.actor.default-dispatcher-198] WARN  o.e.j.j.spi.PropertyFileLoginModule - Exception starting propertyUserStore /etc/datahub/plugins/frontend/auth/user.props
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application - The submitted callback is of type: class javax.security.auth.callback.NameCallback : javax.security.auth.callback.NameCallback@698e5531
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application - The submitted callback is of type: class org.eclipse.jetty.jaas.callback.ObjectCallback : org.eclipse.jetty.jaas.callback.ObjectCallback@3128985b
09:56:02 [application-akka.actor.default-dispatcher-198] WARN  application - The submitted callback is unsupported!
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application - The submitted callback is of type: class javax.security.auth.callback.PasswordCallback : javax.security.auth.callback.PasswordCallback@ff0cac0
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application - The submitted callback is of type: class javax.security.auth.callback.NameCallback : javax.security.auth.callback.NameCallback@b448e89
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application - The submitted callback is of type: class org.eclipse.jetty.jaas.callback.ObjectCallback : org.eclipse.jetty.jaas.callback.ObjectCallback@13a044ea
09:56:02 [application-akka.actor.default-dispatcher-198] WARN  application - The submitted callback is unsupported!
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application - The submitted callback is of type: class javax.security.auth.callback.PasswordCallback : javax.security.auth.callback.PasswordCallback@5b1b1891
09:56:02 [application-akka.actor.default-dispatcher-198] ERROR application -

! @7np0ddjge - Internal server error, for (POST) [/logIn] ->

play.api.UnexpectedException: Unexpected exception[RuntimeException: Failed to generate session token for user]
        at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:340)
        at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:263)
        at play.core.server.AkkaHttpServer$$anonfun$1.applyOrElse(AkkaHttpServer.scala:443)
        at play.core.server.AkkaHttpServer$$anonfun$1.applyOrElse(AkkaHttpServer.scala:441)
        at scala.concurrent.Future.$anonfun$recoverWith$1(Future.scala:417)
        at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:41)
        at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
        at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
        at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:92)
        at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
        at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:85)
        at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:92)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:49)
        at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.lang.RuntimeException: Failed to generate session token for user
        at client.AuthServiceClient.generateSessionTokenForUser(AuthServiceClient.java:81)
        at controllers.AuthenticationController.logIn(AuthenticationController.java:141)
        at router.Routes$$anonfun$routes$1.$anonfun$applyOrElse$10(Routes.scala:457)
        at play.core.routing.HandlerInvokerFactory$$anon$6.resultCall(HandlerInvoker.scala:139)
        at play.core.routing.HandlerInvokerFactory$$anon$6.resultCall(HandlerInvoker.scala:138)
        at play.core.routing.HandlerInvokerFactory$JavaActionInvokerFactory$$anon$3$$anon$4$$anon$5.invocation(HandlerInvoker.scala:112)
        at play.core.j.JavaAction$$anon$1.call(JavaAction.scala:128)
        at play.mvc.Action.lambda$call$0(Action.java:89)
        at java.util.Optional.map(Optional.java:215)
        at play.mvc.Action.call(Action.java:81)
        at play.http.DefaultActionCreator$1.call(DefaultActionCreator.java:33)
        at play.core.j.JavaAction.$anonfun$apply$8(JavaAction.scala:188)
        at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
        at scala.util.Success.$anonfun$map$1(Try.scala:255)
        at scala.util.Success.map(Try.scala:213)
        at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
        at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
        at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
        at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
        at play.core.j.HttpExecutionContext$$anon$2.run(HttpExecutionContext.scala:77)
        at play.api.libs.streams.Execution$trampoline$.execute(Execution.scala:70)
        at play.core.j.HttpExecutionContext.execute(HttpExecutionContext.scala:69)
        at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:72)
        at scala.concurrent.impl.Promise$KeptPromise$Kept.onComplete(Promise.scala:372)
        at scala.concurrent.impl.Promise$KeptPromise$Kept.onComplete$(Promise.scala:371)
        at scala.concurrent.impl.Promise$KeptPromise$Successful.onComplete(Promise.scala:379)
        at scala.concurrent.impl.Promise.transform(Promise.scala:33)
        at scala.concurrent.impl.Promise.transform$(Promise.scala:31)
        at scala.concurrent.impl.Promise$KeptPromise$Successful.transform(Promise.scala:379)
        at scala.concurrent.Future.map(Future.scala:292)
        at scala.concurrent.Future.map$(Future.scala:292)
        at scala.concurrent.impl.Promise$KeptPromise$Successful.map(Promise.scala:379)
        at scala.concurrent.Future$.apply(Future.scala:659)
        at play.core.j.JavaAction.apply(JavaAction.scala:189)
        at play.api.mvc.Action.$anonfun$apply$2(Action.scala:95)
        at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307)
        ... 13 common frames omitted
Caused by: java.lang.RuntimeException: Bad response from the Metadata Service: HTTP/1.1 404 Not Found ResponseEntityProxy{[Content-Length: 6739,Chunked: false]}
        at client.AuthServiceClient.generateSessionTokenForUser(AuthServiceClient.java:77)
        ... 48 common frames omitted
any clue on how can I fix this?
we have a demo soon and I need to have this up and running
@incalculable-ocean-74010 @big-carpet-38439 it was my fault in the end, I had a typo in the values file of my deployment so I was deploying an earlier version of the GMS
sorry for the inconvenience and thank you for the effort!
b
Super happy you got this working!
5 Views
Open in Slack
Next
Powered by