In the bootstrap_mce.json, SampleKafkaDataset --&g...
# ingestion
w
In the bootstrap_mce.json, SampleKafkaDataset --> SchemaMetadata --> fields, the 1st field definition is
Copy code
"fields": [
                {
                  "fieldPath": "[version=2.0].[type=boolean].field_foo_2",
                  "jsonPath": null,
                  "nullable": false,
                  "description": {
                    "string": "Foo field description"
                  },
                  "type": {
                    "type": {
                      "com.linkedin.pegasus2avro.schema.BooleanType": {}
                    }
                  },
                  "nativeDataType": "varchar(100)",
                  "globalTags": {
                    "tags": [{ "tag": "urn:li:tag:NeedsDocumentation" }]
                  },
                  "recursive": false
                },
....
]
I checked the type for fieldPath, it's declared just as:
Copy code
fieldPath: SchemaFieldPath
..and SchemaFieldPath is defined as:
Copy code
typeref SchemaFieldPath = string
Question: Is there any significance of mentioning
version
and
type: boolean
in the SchemaFieldPath:
"[version=2.0].[type=boolean].field_foo_2"
?
m
Hi @witty-keyboard-20400, Please checkout this link which describes the significance of type annotated paths - https://datahubproject.io/docs/advanced/field-path-spec-v2. In short, type helps with disambiguation of a specific field.
1