<!here> I have tried to ingest the metadata from a mysql table to datahub and it was ingested successfully but I am doubting it because I am not able to see any data there. I am just able to see what columns are there and the data types (basically the values that are there in header of the SQL table but not the rows that are there). Also if I try to search any data that is there in a row for particular column, I get No data results in UI. I am just wondering whether DataHub provides this feature to search data there or it just ingests the table, columns, column data type or description only. Can anyone help me ?

If you want to search the data, you'll be better off extending products like CKAN. Datahub deals with metadata, and doesn't store actual data of the table

Thanks @better-orange-49102 It will be helpful if you can tell me about some of the tools that we can use for this use case. Also can CKAN be integrated with DataHub or it’s a separate tool that we can use for our use case to store both the metadata and actual data?

CKAN is an older data catalog product. it stores data in its own instance. however, it only accepts flat files and cannot read metadata off a database (hence i say need to extend CKAN yourself). And no, it doesnt work with datahub, though maybe devs would be interested in federating catalogs in the future.

Also is there any option to upload some sample data and manage the access control in Datahub, we are just in exploration phase

info about rbac https://datahubspace.slack.com/archives/CV2KB471C/p1628566369058300

Thanks @better-orange-49102 However just to clarify about our use case, we are actually having relational metadata stored in MySQL but not able to get the actual column names You can refer to my screenshots to understand our use case

but you stored the relational metadata as a table. data hub can retrieve the metadata about the table, but not the data in the table.

Okay so here is one more QQ, How we should store the relational metadata except tables/views?

im not sure why there is a need to store (metadata of a table) in a table... datahub can read the schema of these tables just fine.

Hi @wooden-sunset-90925 from looking at the screenshot it seems like the MySQL table actually contains metadata about other views tables etc.

oh @mammoth-bear-12532 does datahub informs the user of relationship between tables? say primary keys and foreign keys? been meaning to ask about that

@mammoth-bear-12532 Thanks for clarification! we exactly have the same use case and would like to setup the call with you if its possible next week on Monday?

@better-orange-49102: Our models support it, but I don't think our UI currently shows anything for it.. Definitely something we will built out for at least relational tables.. but some work remaining before that