Hello! I am trying to ingest MongoDB metadata to d...
# ingestion
w
Hello! I am trying to ingest MongoDB metadata to datahub with airflow. 3 databases out of 8 are ingested, but at some point i get an error “array type is not backed by a DataList” Does anyone know what this might be? Maybe array fields are not supported? Thank you!
Copy code
'failures': [{'error': 'Unable to emit metadata to DataHub GMS',
                'info': {'exceptionClass': 'com.linkedin.restli.server.RestLiServiceException',
                         'message': "Parameters of method 'ingest' failed validation with error 'ERROR :: "
                                    '/entity/value/com.linkedin.metadata.snapshot.DatasetSnapshot/aspects/1/com.linkedin.schema.SchemaMetadata/fields/5/type/type/com.linkedin.schema.ArrayType/nestedType '
                                    ':: array type is not backed by a DataList\n'
                                    'ERROR :: '
                                    '/entity/value/com.linkedin.metadata.snapshot.DatasetSnapshot/aspects/1/com.linkedin.schema.SchemaMetadata/fields/33/type/type/com.linkedin.schema.ArrayType/nestedType '
                                    ':: array type is not backed by a DataList\n'
                                    'ERROR :: '
                                    '/entity/value/com.linkedin.metadata.snapshot.DatasetSnapshot/aspects/1/com.linkedin.schema.SchemaMetadata/fields/37/type/type/com.linkedin.schema.UnionType/nestedTypes '
d
Which version of datahub are you on? I saw similar error with older datahub version.
w
we have gms version “v0.8.26” the datahub cli on was 0.8.25.1 i will try to rerun it on 0.8.26.3, and see if it disappears!
@dazzling-judge-80093 it worked on the latest version. Thank you!
d
awesome 🙂