Hi All, I’m generating json file with schema: `dat...
# troubleshoot
k
Hi All, I’m generating json file with schema:
datahub get --urn "urn:li:dataset:(urn:li:dataPlatform:bigquery,project_id.dataset.table,DEV)" --aspect schemaMetadata  | jq >schema.json
Then I was trying to upload this schema to new&“empty” datahub. To achieve that I tried with
datahub ingest -c ingest_schema.dhub.yaml
, where
ingest_schema.dhub.yaml
is as follow:
Copy code
# see <https://datahubproject.io/docs/generated/ingestion/sources/file> for complete documentation
source:
  type: "file"
  config:
    filename: schema.json

# see <https://datahubproject.io/docs/metadata-ingestion/sink_docs/datahub> for complete documentation
sink:
  type: "datahub-rest"
  config:
    server: "<https://gms.topic-dev.name.dev>"
anyway I’m still receiving the same error:
Copy code
Command failed with com.linkedin.pegasus2avro.usage.UsageAggregation is missing required field: bucket.
In fact there is no
UsageAggregation
in generated json file. My good guess I’m generating json file in wrong way. Are you able to give me a hint how to do it correctly?