kind-lunch-14188
09/09/2022, 2:05 PMdatahub get --urn "urn:li:dataset:(urn:li:dataPlatform:bigquery,project_id.dataset.table,DEV)" --aspect schemaMetadata | jq >schema.json
Then I was trying to upload this schema to new&“empty” datahub. To achieve that I tried with
datahub ingest -c ingest_schema.dhub.yaml
, where ingest_schema.dhub.yaml
is as follow:
# see <https://datahubproject.io/docs/generated/ingestion/sources/file> for complete documentation
source:
type: "file"
config:
filename: schema.json
# see <https://datahubproject.io/docs/metadata-ingestion/sink_docs/datahub> for complete documentation
sink:
type: "datahub-rest"
config:
server: "<https://gms.topic-dev.name.dev>"
anyway I’m still receiving the same error:
Command failed with com.linkedin.pegasus2avro.usage.UsageAggregation is missing required field: bucket.
In fact there is no UsageAggregation
in generated json file. My good guess I’m generating json file in wrong way. Are you able to give me a hint how to do it correctly?