quick-continent-74418
10/31/2023, 4:24 PMEnum
list of values ?
The list of supported values (and sometimes the explanation) is very valuable and I feel I miss something.
Are people documenting values in the description ? Not documenting at all ? In any different other way ?high-hospital-85984
11/01/2023, 7:43 AMkappa
and got ZERO hits 😅 )
Has anyone tried to model a kappa architecture, including the different versions of processors and target datasets, in Datahub? It might not be super user-friendly for humans, but we have some programatic use cases in mind that would benefit from the graph data.few-receptionist-67008
11/03/2023, 4:24 PMmost-scientist-56654
11/07/2023, 3:00 PMsiblings
aspect. However, after looking into the source code and commit history I realized that it was introduced specifically for associating database entities with dbt
models. So, is the siblings
the only way to actually group similar entities and share metadata between them?
Thanks.high-air-78476
11/08/2023, 2:35 PMglamorous-ambulance-32929
11/09/2023, 10:23 AMclass CustomActionConfig(BaseModel):
# Whether to print the message in upper case.
to_upper: Optional[bool]
# A basic example of a DataHub action that prints all
# events received to the console.
class CustomAction(Action):
@classmethod
def create(cls, config_dict: dict, ctx: PipelineContext) -> "Action":
action_config = CustomActionConfig.parse_obj(config_dict or {})
return cls(action_config, ctx)
def __init__(self, config: CustomActionConfig, ctx: PipelineContext):
self.config = config
def act(self, event: EventEnvelope) -> None:
print("Custom Action! Received event:")
metadata = event.event
print(json.dumps(<http://metadata.as|metadata.as>_dict(), indent=4))
def close(self) -> None:
pass
Thank you for your helpimportant-train-83364
11/09/2023, 11:52 AMpurple-refrigerator-27989
11/16/2023, 4:20 AMfierce-guitar-16421
11/16/2023, 3:51 PMpowerful-dawn-10711
11/21/2023, 12:23 PMlively-terabyte-64366
12/12/2023, 2:42 PMentities_enabled:
sources: 'NO'
hallowed-artist-55761
12/26/2023, 7:02 AMpowerful-dawn-10711
12/28/2023, 9:02 AMadorable-salesclerk-90917
01/04/2024, 6:05 PMminiature-intern-36799
01/10/2024, 7:19 PMlimited-monitor-26855
01/19/2024, 4:58 AMmillions-art-55322
01/25/2024, 3:56 PMsalmon-quill-44349
02/06/2024, 1:39 PM'Unable to emit metadata to DataHub GMS:
Can you please help me out on this ?witty-butcher-82399
02/06/2024, 4:11 PMstatus
aspect. Is there any reason for that? we are planning on a contribution for that 🙂
- name: domain
doc: A data domain within an organization.
category: core
keyAspect: domainKey
aspects:
- domainProperties
- institutionalMemory
- ownership
In most of (all?) other entities, deletion is implemented as soft-deletion, whereas in Domains a hard-deletion is performed (well... that's my guess giving the missing status
aspect 😅).
Also, status
aspect is the one supporting the stateful ingestion feature in the connectors. Actually, we have a custom connector for domains and we are thinking on implementing the stateful ingestion feature and so that's when we missed the aspect.gifted-diamond-19544
02/19/2024, 11:59 AMcalm-alligator-12692
02/20/2024, 9:26 AMcalm-alligator-12692
02/20/2024, 9:28 AMabundant-journalist-31750
02/21/2024, 6:30 PMchilly-processor-85299
02/29/2024, 5:33 PMlimited-motherboard-51317
03/02/2024, 2:13 PMlimited-motherboard-51317
03/05/2024, 12:45 PMincalculable-park-61483
03/06/2024, 6:50 PMred-actor-28068
03/12/2024, 3:03 PMlittle-painter-30105
03/12/2024, 11:33 PMldap
user name (datahub signed in user) in Datahub for these Airflow entities (DAGs and tasks). How can I update Airflow owner name in Datahub (keeping different Airflow owner in Airflow UI) ? Is there a way we can update using API calls or ingestion in Datahub?strong-father-14840
03/13/2024, 2:33 PM