Any help will be appreciated. Thanks!
# advice-metadata-modelingb
brave-farmer-39785
10/24/2022, 1:00 AMAny help will be appreciated. Thanks!
e
echoing-airport-49548
10/24/2022, 5:51 PMHey @brave-farmer-39785 let me take a look into this and get back to you
echoing-airport-49548
10/24/2022, 11:07 PMHave you tried executing this search via the UI instead of making this POST request?
b
brave-farmer-39785
10/25/2022, 3:48 PMSorry for the late response. My dev environment is having issue. Thanks for the suggestion. Here is the response from GUI:
brave-farmer-39785
10/25/2022, 3:48 PMSame Docker error message: "[query_string] analyzer [custom_keyword] not found"
What do I need to do to create the analyzer?
e
echoing-airport-49548
10/25/2022, 4:30 PMso are other search queries working okay or no?
b
brave-farmer-39785
10/25/2022, 4:43 PMIt works fine for other searches. It just doesn't work for the new entity.
e
echoing-airport-49548
10/25/2022, 4:45 PMwould you mind sharing the
.pdlb
brave-farmer-39785
10/25/2022, 4:52 PMThat's correct. I am using @Searchable.
VendorKey.pdl:
namespace com.company.metadata.key
/**
* Key for a Vendor
*/
@Aspect = {
"name": "vendorKey"
}
record VendorKey {
/**
* A unique id for the vendor. Should be separate from the name used for displaying a Vendor.
*/
id: string
}
VendorInfo.pdl:
namespace com.company.vendor
@Aspect = {
"name": "vendorInfo"
}
record VendorInfo {
@Searchable = {
"fieldType": "KEYWORD",
"enableAutocomplete": true,
"queryByDefault": true,
"boostScore": 10.0
}
name: string
phone: string
contact: optional string
url: optional string
}
e
echoing-airport-49548
10/25/2022, 5:11 PMokay so i would actually recommend you use
"fieldType": "TEXT_PARTIAL"echoing-airport-49548
10/25/2022, 5:12 PMif you change that, you will have to rebuild indices however
b
brave-farmer-39785
10/25/2022, 5:40 PMI can give it a try. How do I rebuild the indices?
e
echoing-airport-49548
10/25/2022, 5:50 PMWe have some docs here https://datahubproject.io/docs/how/restore-indices
b
brave-farmer-39785
10/25/2022, 8:24 PMSame error.
brave-farmer-39785
10/25/2022, 8:26 PMI also check the index which have the latest timestamp and here is the index. Is there supposed to be an analyzer entry inside the index?
{
"vendorindex_v2": {
"aliases": {},
"mappings": {
"properties": {
"name": {
"type": "text",
"fields": {
"keyword": {
"type": "keyword",
"ignore_above": 256
}
}
},
"runId": {
"type": "text",
"fields": {
"keyword": {
"type": "keyword",
"ignore_above": 256
}
}
},
"urn": {
"type": "text",
"fields": {
"keyword": {
"type": "keyword",
"ignore_above": 256
}
}
}
}
},
"settings": {
"index": {
"creation_date": "1666728563660",
"number_of_shards": "1",
"number_of_replicas": "1",
"uuid": "10JbzOc-SAy-_lcNGb0LjQ",
"version": {
"created": "7090399"
},
"provided_name": "vendorindex_v2"
}
}
}
}
brave-farmer-39785
10/31/2022, 4:52 PMAny other suggestion?
Here is the registry entry for the new entity:
id: mycompany-dq-model
entities:
- name: dataset
aspects:
- customDataQualityRules
- name: vendor
doc: Vendor represents a company that provides products and/or services (e.g data publishers).
keyAspect: vendorKey
aspects:
- vendorInfo
e
echoing-airport-49548
10/31/2022, 4:53 PMHey sorry Jet taking another look
l
lively-dusk-19162
03/29/2023, 12:53 PMHey @brave-farmer-39785 ,
I have been trying to create a new entity from been a while. When you are creating a new entity have you forked datahub or have you used datahub-custom-model?
lively-dusk-19162
03/29/2023, 12:54 PMI have tried datahub fork instead of custom model. I have faced so many errors which i am unaware of
lively-dusk-19162
03/29/2023, 12:54 PMCould you please help me in achieving new entity creation.
3 Views