Hi guys, its posible to add owners to a dataset us...
# ingestionf
few-air-56117
06/21/2022, 8:43 AMHi guys, its posible to add owners to a dataset using the python emmiter?
b
better-orange-49102
06/21/2022, 8:43 AMyes
f
few-air-56117
06/21/2022, 8:43 AMDo you have any docs/example 😄 ?
b
better-orange-49102
06/21/2022, 8:43 AMmetadata-ingestion/examples/library/dataset_add_owner.py
f
few-air-56117
06/21/2022, 8:44 AMthx ❤️
few-air-56117
06/21/2022, 8:55 AMi got this error
Copy code
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: <http://localhost:8080/aspects/urn%3Ali%3Adataset%3A%28urn%3Ali%3AdataPlatform%3Abiguqery%2Cam-dwh-t1%2CPROD%29?aspect=ownership&version=0>few-air-56117
06/21/2022, 8:55 AMi added in datahub init the Personal Access Token
b
better-orange-49102
06/21/2022, 8:56 AMno, i think need to add in the script
f
few-air-56117
06/21/2022, 8:56 AMoh, make sens
b
better-orange-49102
06/21/2022, 8:56 AMit doesnt use the info inside ~/.datahubev
f
few-air-56117
06/21/2022, 8:56 AMyea, its the python package, not the cli
few-air-56117
06/21/2022, 9:21 AMit works now
few-air-56117
06/21/2022, 9:21 AMbut it will create another dataset with the same name
few-air-56117
06/21/2022, 9:21 AMfew-air-56117
06/21/2022, 9:37 AMproblably because i have a dataset in a dataset
b
better-orange-49102
06/21/2022, 9:51 AMhmmm if you inspect the MySQL DB, is the new aspect having the same urn as the existing rows?
better-orange-49102
06/21/2022, 10:30 AMhow does a dataset in a dataset work?🤨
f
few-air-56117
06/21/2022, 10:31 AM😂
few-air-56117
06/21/2022, 10:31 AMnormaly is biguqery project.dataset
few-air-56117
06/21/2022, 10:31 AMbut datahub ingest the project like its a dataset
b
better-orange-49102
06/21/2022, 11:03 AMby right, if you specify the urn of the existing dataset in the script, it shouldnt create a new dataset
better-orange-49102
06/21/2022, 11:04 AM Copy code
# Inputs -> owner, ownership_type, dataset
owner_to_add = make_user_urn("jdoe")
ownership_type = OwnershipTypeClass.DATAOWNER
dataset_urn = make_dataset_urn(platform="hive", name="realestate_db.sales", env="PROD") => if you replace this with the urn of the existing datast instead of calling the make_dataset_urn functionf
few-air-56117
06/21/2022, 11:11 AMi tried
Copy code
dataset_urn = "urn:li:dataset:(urn:li:dataPlatform:bigquery,test-dataset-creation,PROD)"b
better-orange-49102
06/21/2022, 11:16 AMim not very familiar with how bigquery datasets urn will look like when you have different BQ projects 🤷♂️, but i hope you found what you needed? else you might want to consider starting a new question thread