Hi Team, Facing issue with Publishing Lineage. When adding multiple lineage , the first set of lineage is not getting published: ( first input and output is not getting published )

- input-datasets:
    - <s3://enterprise/Atemp>
    output-datasets:
    - <s3://enterprise/A>
  - input-datasets:
    - <s3://enterprise/A>
    output-datasets:
    - <s3://enterprise/B>
  - input-datasets:
    - <s3://enterprise/B>
    output-datasets:
    - <hdfs://enterprise/C>
  - input-datasets:
    - <hdfs://enterprise/C>
    output-datasets:
    - <s3://enterprise/D>
  - input-datasets:
    - <s3://enterprise/D>
    output-datasets:
    - <glue://db.table1>

GMS Logs:

2023-05-08 19:04:06,204 [qtp944427387-20] INFO  c.l.m.r.entity.AspectResource:166 - INGEST PROPOSAL proposal: {aspectName=upstreamLineage, entityUrn=urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newA,PROD), entityType=dataset, aspect={contentType=application/json, value=ByteString(length=181,bytes=7b227570...227d5d7d)}, changeType=UPSERT}
[enterprise, newA]
2023-05-08 19:04:06,315 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.h.s.SiblingAssociationHook:104 - Urn urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newA,PROD) received by Sibling Hook.
2023-05-08 19:04:06,346 [qtp944427387-97] INFO  c.l.m.r.platform.PlatformResource:61 - Emitting platform event. name: entityChangeEvent, key: entityChangeEvent-urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newA,PROD)
2023-05-08 19:04:06,422 [pool-13-thread-1] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /aspects?action=ingestProposal - ingestProposal - 200 - 218ms
2023-05-08 19:04:06,427 [pool-13-thread-2] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /platform?action=producePlatformEvent - producePlatformEvent - 200 - 81ms
2023-05-08 19:04:06,429 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.h.s.SiblingAssociationHook:104 - Urn urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newA,PROD) received by Sibling Hook.
2023-05-08 19:04:06,449 [qtp944427387-18] INFO  c.l.m.r.entity.AspectResource:166 - INGEST PROPOSAL proposal: {aspectName=upstreamLineage, entityUrn=urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newB,PROD), entityType=dataset, aspect={contentType=application/json, value=ByteString(length=178,bytes=7b227570...227d5d7d)}, changeType=UPSERT}
2023-05-08 19:04:06,452 [ThreadPoolTaskExecutor-1] INFO  c.d.event.PlatformEventProcessor:47 - Consuming a Platform Event
2023-05-08 19:04:06,495 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.h.s.SiblingAssociationHook:104 - Urn urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newB,PROD) received by Sibling Hook.
[enterprise, newB]
2023-05-08 19:04:06,566 [qtp944427387-140] INFO  c.l.m.r.platform.PlatformResource:61 - Emitting platform event. name: entityChangeEvent, key: entityChangeEvent-urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newB,PROD)
2023-05-08 19:04:06,568 [pool-13-thread-3] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /platform?action=producePlatformEvent - producePlatformEvent - 200 - 2ms
2023-05-08 19:04:06,569 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.h.s.SiblingAssociationHook:104 - Urn urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newB,PROD) received by Sibling Hook.
2023-05-08 19:04:06,578 [ThreadPoolTaskExecutor-1] INFO  c.d.event.PlatformEventProcessor:47 - Consuming a Platform Event
2023-05-08 19:04:06,617 [pool-13-thread-4] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /aspects?action=ingestProposal - ingestProposal - 200 - 168ms
2023-05-08 19:04:07,001 [I/O dispatcher 1] INFO  c.l.m.s.e.update.BulkListener:47 - Successfully fed bulk request. Number of events: 20 Took time ms: -1
2023-05-08 19:04:32,386 [qtp944427387-18] INFO  c.l.m.r.entity.AspectResource:166 - INGEST PROPOSAL proposal: {aspectName=upstreamLineage, entityUrn=urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newA,PROD), entityType=dataset, aspect={contentType=application/json, value=ByteString(length=181,bytes=7b227570...227d5d7d)}, changeType=UPSERT}
2023-05-08 19:04:32,420 [pool-13-thread-5] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /aspects?action=ingestProposal - ingestProposal - 200 - 34ms
2023-05-08 19:04:32,421 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.h.s.SiblingAssociationHook:104 - Urn urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newA,PROD) received by Sibling Hook.
2023-05-08 19:04:32,443 [qtp944427387-97] INFO  c.l.m.r.entity.AspectResource:166 - INGEST PROPOSAL proposal: {aspectName=upstreamLineage, entityUrn=urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newB,PROD), entityType=dataset, aspect={contentType=application/json, value=ByteString(length=178,bytes=7b227570...227d5d7d)}, changeType=UPSERT}
2023-05-08 19:04:32,479 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.h.s.SiblingAssociationHook:104 - Urn urn:li:dataset:(urn:li:dataPlatform:s3,enterprise/newB,PROD) received by Sibling Hook.

Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: ✅ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? ✅ button ✅ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? ✅ button Did you find a solution to your issue? ❌ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react ✅ to your original message to let us know!

Hi @handsome-football-66174 Which connector are you using ?