abundant-dinner-2901
08/17/2021, 10:03 AMbootstrap_mce.json
in metadata-ingestion
. I had to add MLModelGroup to make the scienceModel
selectable in UI. These are issues I found with this sample `bootstrap_mce.json`:
1. scienceModel
MLModel details page doesn’t have any lineage buttons or description of connections to training/evaluation datasets (compare it with view from demo). ML Group has View Graph
button so Model -> Group lineage is visible in the graph.
2. Browse ML Models
and ML Groups
don’t show any entities, but these entities are searchable
3. MLModel has TrainingData
and EvaluationData
defined, but it’s not visible in the model details, also this is not visible in the dataset details. I’ve added pageViewsHive
dataset in ingestion sample dataset, but it didn’t show any relations to scienceModel
in lineage graph and in Downstream section of Lineage details
I’ve tested it on v0.8.8
, v0.8.10
, master
from yesterday. I tested both elasticseach
and neo4j
graph storage - the same results. What have I missed to make it working?abundant-dinner-2901
08/17/2021, 10:07 AMbootstrap_mce.json
to reproduce it with ./docker/ingestion/ingestion.sh
. This sample is slightly fixed to avoid errors on querying from DataHub UI (added mlModelGroup
, link to mlModelGroup
from mlModel
, removed Cost
from MLModel
because of NPE in GraphQL mapper with costId
loud-island-88694
loud-island-88694
loud-island-88694
loud-island-88694
abundant-dinner-2901
08/18/2021, 6:34 AMambitious-airline-8020
08/18/2021, 6:38 AMabundant-dinner-2901
08/18/2021, 6:50 AMloud-island-88694
early-lamp-41924
08/18/2021, 10:18 PMearly-lamp-41924
08/18/2021, 10:19 PMearly-lamp-41924
08/18/2021, 10:20 PMabundant-dinner-2901
08/19/2021, 6:10 AMearly-lamp-41924
08/19/2021, 6:58 AMabundant-dinner-2901
08/23/2021, 8:28 PMtrainingJobs
/ downstreamJobs
, but not datasets as I expected. I also found that it’s not possible to link MLModel
to MLFeatureTable
, I need to define all MLFeature
which are contained by MLModel
- it’s really hard, because MLFeatureTable
defined in one process, while MLModel
in another one. Do you have any plans on connecting MLFeatureTable
to MLModel
?early-lamp-41924
08/24/2021, 6:51 AMabundant-dinner-2901
08/24/2021, 6:59 AMearly-lamp-41924
08/24/2021, 4:29 PM