hi, could datahub UI search find tables whose docu...
# all-things-deploymente
enough-eve-67949
08/02/2023, 10:33 AMhi, could datahub UI search find tables whose document or field description contain the query
➕ 1
🧠 1
o
orange-night-91387
08/02/2023, 8:59 PMYes, these are searchable fields that are by default queried when doing a search
e
enough-eve-67949
08/03/2023, 3:16 AM@orange-night-91387 I tried, but it won’t give me the table whose field description contains my query. I wonder if it needs to be restricted in english language, because I wrote my description in Chinese. thanks
a
aloof-gpu-11378
08/03/2023, 4:30 PMWhat description did you write? Was it more than 3 characters and was your search query also more than 3 characters?
e
enough-eve-67949
08/04/2023, 2:08 AM@orange-night-91387 a field description is
日频k线的开盘价格开盘开盘价格enough-eve-67949
08/04/2023, 2:10 AMand I test the query in English. it works, it could find the table whose column descriptions contain the query.
enough-eve-67949
08/04/2023, 2:14 AMor is there any option to set in datahub/elastic search that make them support utf-8 characters
a
aloof-gpu-11378
08/04/2023, 5:11 PMAh, so this is a limitation on how we're dividing "words."
日频k线的开盘价格日频k线开盘价格aloof-gpu-11378
08/04/2023, 5:12 PMI can definitely understand why this wouldn't be an ideal tokenization strategy for Chinese where each character can really be a full word or even more on its own, but would probably require custom tokenization strategies configured in ElasticSearch by language
aloof-gpu-11378
08/04/2023, 5:14 PMYou may want to look into: https://datahubproject.io/docs/how/search/#customizing-search
aloof-gpu-11378
08/04/2023, 5:15 PMThis will require in-depth knowledge of ElasticSearch tokenization & analyzers though to get working in a desirable way
o
orange-night-91387
08/04/2023, 5:22 PMWhat you'll probably want here is full ngram matching instead of just prefix, we don't do this by default because it is very expensive to both performance and ElasticSearch index size.
e
enough-eve-67949
08/16/2023, 9:44 AMthanks for your help. I am trying on elastic tokenization these days but I am not working out on it till now.