Hello Everyone ! Being a newbie with the Datahub, I need a little help troubleshooting an error. While injecting the metadata form the source: file [JSON] and sink: datahub-rest, in a local server after writing the recipe as per the guide; there’s a error showing: “ValueError: com.linkedin.pegasus2avro.usage.UsageAggregation is missing required field: bucket” Can anyone help to understand the error and how to solve it. Thank you in advance :)

if you could share your json file that would be easier to debug, but the error message is simply saying that you didnt populate all the values required for the UsageAggregation class (see pic) i believe you can see the definitions of the class by running

./gradlew :metadata-ingestion:codegen

and it should be specified in schema_class.py inside ./metadata-ingestion/src/datahub/metadata/ folder

No it is not generated from datahub, this is an independent json file I’m trying to ingest 😐

so to correct your understanding, while datahub ingest can take a file as a source, these files need to be generated from a datahub ingest command (or you could create a json file that conform to what it accepts) maybe you could connect datahub to the DB instead and see what it returns?

@better-orange-49102 Thanks for the help and clarification 🙂

This is correct! Thanks for the explanation @better-orange-49102