A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

image.png

Hi Is there an example of using SQL Queries

<@U04N9PYJBEW> please, can you help here?

please, I successfully configured the data source, but the dashborad search found no data (v0.12.0 docker quickstart)

yeah, unfortunately the input file should be in this case on the datahub action’s pod

use the datahub cli which works with file on your local fs

I need to write docs for this, but your queries file has to be in a specific format. Each line should be a json object, with keys:
• query: str
• timestamp: int (epoch timestamp representing when the query was made)
• user: Optional[str] (name of user who made the query)

Thanks for your valuable replies, the mysql lineage works under the combination of mysql source and SQL-Queries (insert sql)

Does this provide an api? For example, when there is an insert sql, the cli constructs a json object and calls the api to update the lineage

We don’t support something like this yet