Hi, question about kafka topic retention. I notice...
# all-things-deploymenta
average-vr-23088
08/02/2022, 4:48 PMHi, question about kafka topic retention. I noticed by default we get a 90 days retention for the “audit” log. Is this log required when replaying data into Elastic Search? In other words, after 90 days have passed, would we be unable to replay some subset of data into Elastic Search (in the event we lose elastic search).
s
square-activity-64562
08/02/2022, 5:33 PMYou can use restore indices to restore the elasticsearch https://datahubproject.io/docs/how/restore-indices
square-activity-64562
08/02/2022, 5:34 PMYou won't be able to restore the timeline related stuff like profiling. People usually just re-run the ingestion to get that back.
a
average-vr-23088
08/02/2022, 5:37 PMmakes sense. I was wondering about what is used as the source data to restore the ES indices. Looking at the link you posted, it looks like they use the latest state from the DB rather than the MAE topic — so my question about topic retention is irrelevant then. Thanks for the link!
2 Views