Hi dear community! I see the folder

metadata

in

datahub/metadata-ingestion/src/*datahub*/

has been deleted, but modules in there are still used in the ingestion process. As example in:

metadata-ingestion/src/datahub/ingestion/extractor/schema_util.py:from datahub.metadata.com.linkedin.pegasus2avro.schema import (
metadata-ingestion/src/datahub/ingestion/extractor/mce_extractor.py:from datahub.metadata.com.linkedin.pegasus2avro.mxe import (
metadata-ingestion/src/datahub/ingestion/extractor/mce_extractor.py:from datahub.metadata.schema_classes import UsageAggregationClass
metadata-ingestion/src/datahub/ingestion/api/workunit.py:from datahub.metadata.com.linkedin.pegasus2avro.mxe import (
metadata-ingestion/src/datahub/ingestion/api/workunit.py:from datahub.metadata.schema_classes import UsageAggregationClass
metadata-ingestion/src/datahub/emitter/kafka_emitter.py:from datahub.metadata.com.linkedin.pegasus2avro.mxe import (
metadata-ingestion/src/datahub/emitter/kafka_emitter.py:from datahub.metadata.schemas import (

Is this a partial code refactoring, or should we restore that folder?

https://datahubproject.io/docs/metadata-ingestion/developing/

./scripts/codegen.sh

Sorry, I don’t get it

Some files were recently deleted. They should be getting auto-generated in docker images. Are you facing some error while running metadata-ingestion?

@stale-jewelry-2440: the code generation should be creating these files. are they not?

That’s the trick, thank you!