hello everyone. I just wonder..
what is the main p...
# all-things-deploymentm
modern-zoo-97059
04/29/2022, 12:38 AMhello everyone. I just wonder..
what is the main purpose of using
mysqlmysqlelastic searchb
big-carpet-38439
04/29/2022, 1:14 AMElastic search only stores the latest metadata for each entity. MySQL stores ALL metadata through history in a versioned document store
big-carpet-38439
04/29/2022, 1:15 AMElastic is better suited for less data since its more expensive to create indexes on all those fields. Document store (MySQL) is more efficient for storing a lot of un-indexed documents
plus1 8
m
mysterious-parrot-80195
04/29/2022, 2:46 AMSorry I haven't study the source code, can I consider that the data displayed on the WebUI is obtained from ES, not mysql? for example the edited description of the fields...
b
big-carpet-38439
04/29/2022, 5:07 PMSo the search results are powered through Elastic, but the actually source of truth for the data you see is the document store - MySQL
r
rapid-book-98432
05/13/2022, 9:46 AM@big-carpet-38439 Hi. Thanks for your explaination. If i goit the point, even if i keep ES dockerized, if for any reason the deployment krashes, ES data will go back to "fresh new state" but won't affect the Datahub usage. Juste the last search will be remove and so ?
b
big-carpet-38439
05/13/2022, 4:10 PMSo typically if the container crashes / goes down the data will not be lost (unless you create a branch new docker volume) - But if elastic loses all data, then you can run a restore indices job that will force reindex everything back into Elastic! @early-lamp-41924 can discuss more