Hi, we're using Kafka with with Druid. Segments ...
# general
r
Hi, we're using Kafka with with Druid. Segments are getting missed after some period of time automatically. It makes missing of data. What might be the root cause ?
s
@Gian Merlino - your views on this will help us
🙌 1
k
This seems to be you have issues loading the segments onto historical nodes for some reason - do you have room for all this data? Have a look in the
Services
tab to see how your historical services are doing. The
coordinator
log might have some hints as well
s
Thanks for the reply @Kyle Hoondert, here is what
services
look like and we have checked
coordinator
logs, we see no errors there. Looking at this do you want to suggest any further steps.
k
This shows your historical is full. You need to scale it, add another or change retention (drop data)
s
Thanks a ton for pointing this !
r
Hi, We've enough storage.
k
Check that
druid.server.maxSize
and
druid.segmentCache.locations
are set appropriately in the historical runtime.properties https://druid.apache.org/docs/latest/configuration/#historical-general-configuration - these are used to determine how much storage is used by Druid
✅ 1
r
@Kyle Hoondert This works! thank you so much 🙂
k
Also based on the number of segments, you should really think about turning on compaction.