creamy-wall-36971
08/30/2023, 6:49 AMfrom datahub.ingestion.graph.client import DatahubClientConfig, DataHubGraph
import time
gms_endpoint = "#######"
graph = DataHubGraph(DatahubClientConfig(server=gms_endpoint))
start = time.time()
for i in range(len(df)):
term_urn = "urn:li:glossaryTerm:" + df['공통표준용어명'][i]
mutation = f"""
mutation batchRemoveTerms {{
batchRemoveTerms(
input: {{
termUrns: ["{term_urn}"],
resources: []
}}
)
}}
"""
result = graph.execute_graphql(query=mutation)
print(result)
end = time.time()
print(f"{end - start: .2f} sec")
freezing-controller-51212
08/30/2023, 7:33 PM0.2.181
to 0.2.182
We are ingesting metadata from Databricks, Sagemaker, dbt. When displaying the logs of these 3 jobs, I get recurring similar errors being :
• datahub-gms return status 500 (see picture)
• Error registering Avro Schema
Even after trying the solution propsed in this issue the problem keeps recurring.
Thank you for the help!tall-gigabyte-99212
08/31/2023, 3:50 AMrhythmic-sundown-12093
08/31/2023, 6:27 AMjava.util.concurrent.CompletionException: org.pac4j.core.exception.TechnicalException: com.nimbusds.jose.proc.BadJOSEException: Signed JWT rejected: Another algorithm expected, or no matching key(s) found
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:319)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1702)
at play.core.j.HttpExecutionContext.$anonfun$execute$1(HttpExecutionContext.scala:64)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: org.pac4j.core.exception.TechnicalException: com.nimbusds.jose.proc.BadJOSEException: Signed JWT rejected: Another algorithm expected, or no matching key(s) found
at org.pac4j.oidc.profile.creator.OidcProfileCreator.create(OidcProfileCreator.java:145)
at org.pac4j.oidc.profile.creator.OidcProfileCreator.create(OidcProfileCreator.java:45)
at org.pac4j.core.client.BaseClient.retrieveUserProfile(BaseClient.java:119)
at org.pac4j.core.client.BaseClient.getUserProfile(BaseClient.java:99)
at org.pac4j.core.engine.DefaultCallbackLogic.perform(DefaultCallbackLogic.java:88)
at auth.sso.oidc.OidcCallbackLogic.perform(OidcCallbackLogic.java:100)
at controllers.SsoCallbackController$SsoCallbackLogic.perform(SsoCallbackController.java:91)
at controllers.SsoCallbackController$SsoCallbackLogic.perform(SsoCallbackController.java:77)
at org.pac4j.play.CallbackController.lambda$callback$0(CallbackController.java:54)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
... 8 common frames omitted
Caused by: com.nimbusds.jose.proc.BadJOSEException: Signed JWT rejected: Another algorithm expected, or no matching key(s) found
at com.nimbusds.jwt.proc.DefaultJWTProcessor.process(DefaultJWTProcessor.java:384)
at com.nimbusds.openid.connect.sdk.validators.IDTokenValidator.validate(IDTokenValidator.java:288)
at com.nimbusds.openid.connect.sdk.validators.IDTokenValidator.validate(IDTokenValidator.java:224)
at org.pac4j.oidc.profile.creator.TokenValidator.validate(TokenValidator.java:103)
at org.pac4j.oidc.profile.creator.OidcProfileCreator.create(OidcProfileCreator.java:93)
... 17 common frames omitted
some-flower-21264
08/31/2023, 8:05 AMtall-gigabyte-99212
08/31/2023, 10:36 AMtall-gigabyte-99212
08/31/2023, 10:39 AMpowerful-cat-68806
08/31/2023, 12:48 PMacoustic-lawyer-52945
08/31/2023, 8:03 PMsome-actor-27079
08/31/2023, 9:07 PMdatahub-datahub-system-update-job
which keeps on failing.
If I modify the prerequisites and the datahub values.yaml as suggested here:
https://github.com/acryldata/datahub-helm/issues/347
This is:
"""
Filling values in prerequisites:
cp-helm-charts:
enabled: true
cp-schema-registry:
enabled: true
and values in datahub:
kafka:
schemaregistry:
type: KAFKA
url: "<http://datahub-datahub-gms:8080/schema-registry/api/>"
"""
I am able to helm install the prerequisites without issues. I am also able to helm install datahub. However, in the front-end I don't have an "Ingestion" tab. If I write "http:my-datahub.domain/ingestion" I get an error "Failed to load ingestion sources! An unexpected error occurred" (see image). If I try to ingest some data, I get another error: "Unauthorized to perform this action. Please contact your DataHub administrator (code 403)." (see image).
Does anyone have any clue on how to fix these errors?
Any tips would be greatly appreciated!tall-gigabyte-99212
09/01/2023, 7:16 AMancient-kitchen-28586
09/01/2023, 12:31 PMgifted-laptop-70221
09/01/2023, 1:07 PMsome-flower-21264
09/01/2023, 3:37 PMwhite-appointment-14217
09/01/2023, 5:23 PMcp-helm-charts:
cp-schema-registry:
enabled: true
podSecurityContext:
fsGroup: 1000
securityContext:
runAsUser: 1000
prometheus:
securityContext:
runAsUser: 1000
jmx:
securityContext:
runAsUser: 1000
kafka:
bootstrapServers: "prerequisites-kafka:9092"
cp-kafka:
enabled: false
cp-zookeeper:
enabled: false
cp-kafka-rest:
enabled: false
cp-kafka-connect:
enabled: false
cp-ksql-server:
enabled: false
cp-control-center:
enabled: false
chilly-potato-57465
09/04/2023, 2:12 PMwide-ability-48958
09/05/2023, 5:06 AMorange-gpu-90973
09/05/2023, 5:56 AMbetter-orange-49102
09/05/2023, 8:41 AMfuture-controller-3884
09/05/2023, 2:58 PMbrainy-butcher-66683
09/05/2023, 6:11 PMdatahub
database needed in the my standalone db via the deployment helm chart ?wonderful-cpu-12969
09/05/2023, 7:12 PMdatahub-system-update-job
with the below error. I have also attached the log.
2023-09-04 16:29:19,467 [main] INFO i.e.d.pool.PooledConnectionQueue:405 - Reseting DataSourcePool [gmsEbeanServiceConfig] min[2] max[50] free[0] busy[0] waiting[0] highWaterMark[0] waitCount[0] hitCount[0]
2023-09-04 16:29:19,468 [main] INFO i.e.d.pool.PooledConnectionQueue:411 - Busy Connections:
2023-09-04 16:29:19,470 [main] ERROR c.l.g.f.entity.EbeanServerFactory:38 - Failed to connect to the server. Is it up?
ERROR SpringApplication Application run failed
org.springframework.beans.fa
This is the jdbc connection url : "jdbc:mysql://mysqlsrv05092023.mysql.database.azure.com:3306/datahub?verifyServerCertificate=false&useSSL=true&useUnicode=yes&characterEncoding=UTF-8&enabledTLSProtocols=TLSv1.2"
Has anyone come across similar error and resolved this?creamy-wall-36971
09/06/2023, 2:04 AMadamant-iron-62899
09/06/2023, 7:58 AMloud-gpu-36404
09/08/2023, 1:09 PMorange-gpu-90973
09/08/2023, 2:31 PMgorgeous-tent-62316
09/08/2023, 4:38 PMaverage-vr-23088
09/08/2023, 6:51 PMproud-table-38689
09/10/2023, 7:33 PMMetadataAuditEvent_v4
, DataHubUpgradeHistory_v1
)many-wolf-97286
09/11/2023, 6:36 PMOSError: [E050] Can't find model '*en_core_web_sm*'. It doesn't seem to be a Python package or a valid path to a data directory.