rich-policeman-92383
05/01/2023, 8:09 AM[2023-04-30 18:24:05,254] ERROR {datahub.utilities.sqlalchemy_query_combiner:403} - Failed to execute queue using combiner: (trino.exceptions.TrinoQueryError) TrinoQueryError(type=INSUFFICIENT_RESOURCES, name=EXCEEDED_TIME_LIMIT, message="Query exceeded the maximum execution time limit of 10.00m"
["Profiling exception (trino.exceptions.OperationalError) error 404: b'Query not found'\n(Background on this error at: <https://sqlalche.me/e/14/e3q8>)"]
Recipe yaml:
source:
type: "trino"
config:
host_port: ip:port
database: hive_2
username: tr
password:
schema_pattern:
deny:
- .*information_schema.*
allow:
- B
- A
table_pattern:
allow:
- hive_2.A.table1
- hive_2.B.table2
profiling:
enabled: True
profile_pattern:
allow:
- hive_2.A.table1
- hive_2.B.table2
transformers:
- type: "simple_add_dataset_tags"
config:
tag_urns:
- "urn:li:tag:1_0_prod_datalake"
pipeline_name: "trino_hive_prod_to_datahub_prod"
datahub_api:
server: "<https://gms:8080>"
token:
sink:
type: "datahub-rest"
config:
server: "<https://gms:8080>"
token:
lively-cat-88289
05/01/2023, 8:09 AMrich-policeman-92383
05/01/2023, 9:19 AMconnect_args={
"session_properties": {'query_max_run_time': '1d'},
"client_tags": ["tag1", "tag2"],
"roles": {"catalog1": "role1"},
}
rich-policeman-92383
05/01/2023, 3:18 PMoptions:
connect_args:
http_scheme: http
session_properties:{'query_max_execution_time': '1d'}