Hello, This may be a question that could be easily...
# getting-startedh
hallowed-dinner-34937
10/09/2020, 2:06 PMHello, This may be a question that could be easily answered if I just venture into the github repo and look around but I decided to take this route instead! aha!.. I'm wondering if there is any documentation or if someone could point me towards the code that would show me how the datahub API works.
We're currently looking to try to ingest data into datahub through external purposes. For example, an external process will create some documentation in google drive when a new table/entity is created, after this another seperate process will push the link to this google doc into the datahub along with the new table.
a
acceptable-architect-70237
10/09/2020, 2:53 PMacceptable-architect-70237
10/09/2020, 2:54 PMthere are basic full list of api endpoints that you can use to ingest your dataset
acceptable-architect-70237
10/09/2020, 2:55 PMif you use postman, here is the postman I compiled :https://github.com/liangjun-jiang/datahub/blob/column-level-lineage/contrib/postman/linkedin-datahub.postman_collection.json
h
hallowed-dinner-34937
10/09/2020, 2:59 PMSweet Thank you! @acceptable-architect-70237
hallowed-dinner-34937
10/09/2020, 3:41 PM@acceptable-architect-70237 Another question: How are "updates" handled? for example, instead of creating a new table/dataset/entity, we want to update the existing entry in datahub with some documentation OR change some field of the existing entry in datahub. OR What would be best practice if we want an interface to trigger a push of a field item of a dataset into datahub?
a
acceptable-architect-70237
10/09/2020, 3:52 PMLinkedIn team probably will answer this better.
h
hallowed-dinner-34937
10/09/2020, 3:56 PM@bumpy-keyboard-50565
b
bumpy-keyboard-50565
10/09/2020, 5:30 PM@hallowed-dinner-34937 not sure I fully understand your question, but if you're asking how to "partial update" some metadata for the dataset, the answer is aspects: https://github.com/linkedin/datahub/blob/master/docs/what/aspect.md
a
acceptable-architect-70237
10/12/2020, 2:53 PMI think the question is about the update API of CRUD. My rough understanding is that datahub doesn't really update the existing entity, it creates new entity with a different version.
b
bumpy-keyboard-50565
10/12/2020, 3:42 PMCould you clarify, @hallowed-dinner-34937?
h
hallowed-dinner-34937
10/13/2020, 1:52 PM@bumpy-keyboard-50565 I'm looking for something @acceptable-architect-70237 just mentioned. The update API in the CRUD, as he mentioned i also understood it was only a create new entity rather than update the existing. I asked to make sure that was correct
👍 1
hallowed-dinner-34937
10/15/2020, 2:08 PMHi @bumpy-keyboard-50565, I would love to learn more about metadata aspects that you mentioned above to see how and where we can use it. Do you have any more docs and/or examples of where it's used?
b
bumpy-keyboard-50565
10/16/2020, 11:27 AMAspect is a core concept of the architecture so you'll probably find it mentioned everywhere in the doc. Here's an example of how to add a new aspect if it helps: https://github.com/linkedin/datahub/blob/master/docs/how/add-new-aspect.md. You can also find a live demo from our past town hall: https://bluejeans.com/playback/s/tATwQsjyM20cSRCXQ0gTHELoE5MOligFZK1GXZz1xqEZfZMkJMg4mgGNgWfdtE3p
👍 1
2 Views