gray-airplane-39227
12/19/2023, 7:47 PMplatform_instance
is missing from recipe? Thank you!clever-ice-25576
01/02/2024, 8:08 PMlate-electrician-25891
01/04/2024, 5:45 AMprehistoric-dream-62416
01/08/2024, 11:34 AMripe-eye-60209
01/08/2024, 1:21 PMfresh-petabyte-24461
01/08/2024, 7:06 PMfuture-controller-3884
01/11/2024, 5:49 AMmost-refrigerator-85564
01/11/2024, 3:13 PMgray-airplane-39227
01/11/2024, 7:18 PMdelimited_name
to make sure output is consistent.thankful-sunset-61734
01/12/2024, 10:22 AMstraight-cricket-47915
01/22/2024, 8:32 AMadventurous-dawn-19232
01/23/2024, 10:54 AMquiet-television-68466
01/24/2024, 3:04 PMaccessRequest
and accessRequests
where an accessRequest
contains an auditStamp
and a stringMap of additionalMetadata
(similar to custom properties).
2. We attached accessRequests
to datasets
, containers
and dataProducts
3. We implemented a graphQL query addAccessRequest
which takes looks like this
mutation addAccessRequest {
addAccessRequest(input: {
resourceUrn: "urn:li:dataset:(urn:li:dataPlatform:hive,SampleHiveDataset,PROD)"
additionalMetadata: [
{
key: "why2"
value: "I need it"
},
{
key: "who"
value: "The Data Platform group"
}
]
})
}
4. We also implemented a button that contains a form that looks like (image attached) which submits the addAccessRequest ticket. (This could likely be made more modular by someone else)
5. Finally we have an action that runs that takes tickets and assigns them to a freshservice queue based on the domain attached (but we could contribute a simpler version that just requires a group_id and freshservice_api key in the config (or as secrets).
Not sure which components of these would be useful for other people, but I thought it would at least start a discussion!square-mouse-38194
01/26/2024, 5:28 PMlimited-monitor-26855
01/31/2024, 5:44 AM"Unknown entity type: INGESTION_SOURCE"
. Note: Change the type to any other EntityType will return correct results
query SearchIngestionSourcesWithoutFilter {
search(input: {
type: INGESTION_SOURCE,
query: "*",
start: 0,
count: 10
}) {
start,
count,
total: count,
searchResults {
entity {
urn
}
}
}
}
quick-pizza-8906
02/01/2024, 8:40 PM:metadata-ingestion:lint
task succeeds locally
Does anybody have any idea what is happening there? I notice master builds succeed...fresh-petabyte-24461
02/06/2024, 12:46 AMfresh-petabyte-24461
02/12/2024, 9:08 PMshiro-core
due to a vulnerability. please take a look. thanksfresh-petabyte-24461
02/12/2024, 10:03 PMfastapi
and gitdb
due to a vulnerability. please take a look. thanksgray-airplane-39227
02/14/2024, 7:46 PMMap
attribute type in DynamoDB: https://github.com/datahub-project/datahub/pull/9852
2. improve sorting when downsampling collection schema, this would allow the output to be consistent with alphabetical order, relatively small: https://github.com/datahub-project/datahub/pull/9856
Would be greatly appreciate if team can have a look 🙏🙏🙏ripe-agency-8696
02/15/2024, 4:17 AMdry-raincoat-85182
02/15/2024, 1:24 PMadamant-article-76582
02/16/2024, 7:09 PMmost-scientist-56654
02/23/2024, 8:49 AMlemon-processor-68383
02/26/2024, 9:03 PMsome-crowd-4662
02/27/2024, 5:33 PMaverage-vr-23088
02/27/2024, 8:56 PMpython setup.py build
on the datahub-airflow-plugin. Is this the right approach? I’ve also tried to install the necessary python dependencies but i’m getting errors from Airflow when it tries to load the plugin.
I’m currently getting the following error:
File "/usr/local/airflow/plugins/datahub_airflow_plugin/datahub_listener.py", line 19, in <module>
aws-mwaa-local-runner-2_7-local-runner-1 | from datahub.sql_parsing.sqlglot_lineage import SqlParsingResult
aws-mwaa-local-runner-2_7-local-runner-1 | ModuleNotFoundError: No module named 'datahub.sql_parsing'
This is despite me installing the acryl-datahub[sql-parser]==0.12.1.5
package.
Any guidance would be much appreciated!average-vr-23088
02/27/2024, 9:29 PMdatahub.sql_parsing
? I see that its part of the main acryl-datahub but for some reason i can’t do that import when i install 0.12.1.5able-evening-90828
03/01/2024, 1:47 AMfaint-painting-38451
03/05/2024, 6:00 PM