Hi.... Is there an equivalent to the `DataFlowSnap...
# ingestion
m
Hi.... Is there an equivalent to the
DataFlowSnapshotClass
for ML flows (like kubeflow pipelines). I looked thro the schema_classes.py definitions but nothing stood out.... Thanks....
b
Today, there is not this model. However, DataFlow could presumably be extended to support metadata for ML flows...
m
yeah, i did manage to get a kubeflow pipeline into DataFlow without any trouble - just seems it's not quite the right place for it 🙂 But the link to "View in kubeflow" works nicely 🙂
b
Oh awesome!!1
I think we can probably extend the DataFlow to support the ML metadata you'd like to see -- I'm not sure whether we should have separate "flavors" of flow across the normal data processing & ML ecosystems 😛