hi team,Our company has its own scheduling task system such as spark/dataflow/shell........ I want to import it into the datahub. Is there a corresponding model just like dataset for mysql/tidb?
o
orange-night-91387
06/27/2022, 3:35 PM
Hi! Have you checked out DataFlow ? This is what we use for Spark & Airflow pipelines.
c
cuddly-arm-8412
06/28/2022, 10:44 AM
@orange-night-91387 thank you ,i checked it, I would like to know the difference between dataflow /datajob /dataprocess and their application scenarios
o
orange-night-91387
06/28/2022, 5:07 PM
DataProcess is legacy, we shifted to having a DataFlow + DataJob model where DataFlow is the top level definition and DataJob are actual instances of runs.