A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Updated to 0.9.6.1. version and tried to edit Lineage through Web UI (more specifically, through visualised lineage)
At first it seems to be working, I save changes and new connections are displayed on the screen. But once I refresh the tab, all of the changes disappear
What can possibly be the problem?

Hi <@U043LGHBQBA>, what sources are you ingesting from? CC: <@U02DZ51RCK0>

ClickHouse, Kafka, Tableau are the main ones
Worth mentioning, that we also ingest Airflow DAGs, and we include them into Lineage by describing inlets and outlets inside DAGs

Before updating, everything that was not connected automatically or through DAGs parameters, we connected through file based lineage (YAML)

But the connection I tried to add via Web UI didn’t involve DAGs and wasn’t described in yaml before

Particularly, I made a connection between clickhouse and kafka. It seemed to work, but once I refreshed a tab — yeah, it disappeared.

<@U043LGHBQBA> are you seeing any errors on GMS when you add new lineage edges manually?

<@U03V8JZ8GBS> can you help to answer from here?

Hi Guys!
I assume this is the root of our issues:
```2023-02-13 10:44:22.133 GMT [1] LOG:  database system is ready to accept connections
2023-02-13 10:45:12.838 GMT [116] ERROR:  could not serialize access due to concurrent update
2023-02-13 10:45:12.838 GMT [116] STATEMENT:  update metadata_aspect_v2 set metadata=$1, createdOn=$2, createdBy=$3, createdFor=$4, systemmetadata=$5 where urn=$6 and aspect=$7 and version=$8
2023-02-13 10:45:14.467 GMT [117] ERROR:  could not serialize access due to concurrent update```
It happened after we made datahub upgrade on version 0.9.6.1 (Datahub CLI  0.9.6.2)
Let’s keep discussing the issue here.: <https://datahubspace.slack.com/archives/C029A3M079U/p1676285358177959?thread_ts=1675935141.021299&amp;cid=C029A3M079U>