mysterious-park-53124
11/11/2021, 4:28 AMmysterious-park-53124
11/11/2021, 4:29 AMmysterious-park-53124
11/11/2021, 4:29 AMlemon-receptionist-90470
11/25/2021, 12:18 PMenough-london-69397
11/29/2021, 5:29 PM[2021-11-29 13:26:43,382] INFO {datahub.cli.ingest_cli:73} - Starting metadata ingestion
[2021-11-29 13:26:51,316] ERROR {datahub.ingestion.run.pipeline:85} - failed to write record with workunit curated.part_00002_4c6e811b_04cc_4189_80d7_ca7c0c18b959_c000_snappy_parquet with ('Unable to emit metadata to DataHub GMS', {'exceptionClass': 'com.linkedin.restli.server.RestLiServiceException', 'stackTrace': "com.linkedin.restli.server.RestLiServiceException [HTTP Status:500]: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException\n\tat com.linkedin.metadata.restli.RestliUtil.toTask(RestliUtil.java:42)\n\tat com.linkedin.metadata.restli.RestliUtil.toTask(RestliUtil.java:50)\n\tat com.linkedin.metadata.resources.entity.EntityResource.ingest(EntityResource.java:178)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat com.linkedin.restli.internal.server.RestLiMethodInvoker.doInvoke(RestLiMethodInvoker.java:172)\n\tat
...
I used this command to start ingesting: datahub ingest -c ./awsathena_to_datahub.yml
Can anyone help? The UI on localhost works properly thoughenough-london-69397
11/29/2021, 5:59 PMenv
field from config and now it works:
source:
type: athena
config:
aws_region: "us-west-2"
env: "staging"
breezy-camera-11182
01/05/2022, 6:41 AMstrong-iron-17184
01/25/2022, 6:16 PMstrong-iron-17184
01/25/2022, 6:18 PMstrong-iron-17184
01/25/2022, 6:18 PMstrong-iron-17184
01/25/2022, 6:18 PMmost-boots-68766
01/26/2022, 11:56 AMprehistoric-room-17640
02/01/2022, 1:41 PMbetter-orange-49102
02/10/2022, 10:35 AMfew-air-56117
02/23/2022, 8:10 AMehlm install datahub datahub/datahub -f helm_custom_settings_custom_helm.yaml
but i have this error
Error: INSTALLATION FAILED: failed pre-install: timed out waiting for the condition
Thread in Slack Conversationquiet-pilot-28237
03/08/2022, 4:57 AMchilly-nail-87894
03/10/2022, 9:56 PMlittle-megabyte-1074
mysterious-lamp-91034
03/16/2022, 6:24 PMpolite-orange-57255
03/23/2022, 1:24 PMcreamy-van-28626
04/13/2022, 3:18 PMbetter-orange-49102
04/26/2022, 3:43 AMsteep-soccer-91284
04/26/2022, 5:27 AMsteep-soccer-91284
04/26/2022, 8:44 AMmodern-belgium-81337
05/05/2022, 9:11 PMambitious-exabyte-53451
05/12/2022, 12:44 PMswift-airline-90458
05/12/2022, 4:24 PMbetter-orange-49102
05/13/2022, 5:48 AMcreamy-van-28626
05/16/2022, 1:43 PMcreamy-van-28626
05/16/2022, 2:29 PM