• s

    stale-jewelry-2440

    1 year ago
    Hi, do you know where I can find some basic tutorial? As example, I successfully added metadata from my SQL Server source, but I don't know how to delete the test metadata ingested from the "quickstart"
    s
    e
    +3
    14 replies
    Copy to Clipboard
  • b

    better-orange-49102

    1 year ago
    i'm using the quick-start with a custom MCE that i wrote. for me to delete a dataset that i've ingested via the rest api, is there any better/easier way to do so other than to:1. go into mysql and delete record 2. go into ES container and delete document 3. go into neo4j container and delete data is there any other container that i missed out?
    b
    a
    +3
    14 replies
    Copy to Clipboard
  • i

    icy-holiday-55016

    1 year ago
    Hi folks, does Datahub allow for an Airflow task to have multiple output Datasets? Using the lineage_backend_demo.py produces the lineage graph shown in the screenshot below. If I modify that file to add two additional outlet datasets, the lineage graph remains the same if the context is centered on the run_data_task Task. If I switch the context to one of the new datasets I added (for example tableG), it shows the lineage from the originating dataset, omitting the the Task. I'm trying to determine if this is simply a bug, or if Tasks aren't intended to have multiple outlet Datasets. I'm inclined to think its just a bug, as the outlet datasets value is an array, though would be good to confirm. Thanks
    i
    b
    +1
    22 replies
    Copy to Clipboard
  • s

    some-cricket-23089

    1 year ago
    1. Does master branch have all latest changes of 0.7.1 tags 2. I was looking for some tutorial where i can read about the configuration to manage the heirarchy . Please let me know where i can found that. That will be a great help in my exploration part. Please let me know
    s
    g
    17 replies
    Copy to Clipboard
  • i

    icy-holiday-55016

    1 year ago
    Hi folks, is field level lineage supported at the moment? I see there was an RFC for it, and there is code in the repo corresponding to the RFCs, though the docs indicate it's still coming soon. https://datahubproject.io/docs/rfc/active/1841-lineage/field_level_lineage
    i
    l
    +1
    21 replies
    Copy to Clipboard
  • m

    many-egg-4654

    1 year ago
    Hi folks, So I was trying to setup Datahub and I was successful (using Docker containers). So now, I am trying to setup a airflow-lineage-DAG in airflow which is running in conatiner as well on some other port. (Airflow). But while I add the DAG file mentioned here, I am getting a ModuleNotFound Error. Can anyone help me what exactly am I doing wrong here that my DAG import is giving error? or its it some issue with the python module used by Datahub? The DAG I'm trying to import : https://github.com/linkedin/datahub/blob/master/metadata-ingestion/src/datahub_provider/example_dags/mysql_sample_dag.py
    m
    g
    7 replies
    Copy to Clipboard
  • m

    many-egg-4654

    1 year ago
    A little conceptual clarification needed, does Lineage of data also shows me the changes I made to a specific field of database? Suppose for example I deleted/modified a field in Glue, will the Lineage section show me the modifications?
    m
    l
    +1
    5 replies
    Copy to Clipboard
  • m

    mammoth-bear-12532

    1 year ago
    <!here> Just a reminder that this is happening tomorrow!
    m
    l
    +2
    5 replies
    Copy to Clipboard
  • m

    mammoth-bear-12532

    1 year ago
    <!here> In case you missed it, the video for the event is now published!

    https://www.youtube.com/watch?v=fEILyoWVpBw

    m
    1 replies
    Copy to Clipboard
  • b

    broad-flag-97458

    1 year ago
    Hi everyone, I’m trying to get an idea of the minimum production hardware requirements (disk, memory, cpu, etc.) for the four core components of DataHub (GMSMAE ConsumerMCE Consumer, and Frontend). Does anyone have any insights/recommendations (or maybe point me to the doc where that’s outlined)?
    b
    g
    +1
    4 replies
    Copy to Clipboard