https://linen.dev logo
Join Slack
Powered by
# troubleshooting
  • v
    Hdfs can be a source for druid and also as deep storage but you cannot store metadata in hdfs
  • s
    This message was deleted.
    v
    • 2
    • 1
  • v
    Equivalent meaning same capacity as local disk? Yes
  • v
  • s
    Copy code
    2023-01-16T08:38:21,728 INFO [task-runner-0-priority-0] org.apache.kafka.clients.consumer.internals.Fetcher - [Consumer clientId=consumer-kafka-supervisor-hjelfmnc-1, groupId=kafka-supervisor-hjelfmnc] Fetch position FetchPosition{offset=144333390, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-1.kafka-headless.druid.svc.cluster.local:9092 (id: 1 rack: null)], epoch=0}} is out of range for partition druid-0, raising error to the application since no reset policy is configured
2023-01-16T08:38:21,728 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - OffsetOutOfRangeException with message [Fetch position FetchPosition{offset=144333390, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-1.kafka-headless.druid.svc.cluster.local:9092 (id: 1 rack: null)], epoch=0}} is out of range for partition druid-0]
2023-01-16T08:38:21,728 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - Retrying in 30000ms
2023-01-16T08:38:51,733 INFO [task-runner-0-priority-0] org.apache.kafka.clients.consumer.internals.Fetcher - [Consumer clientId=consumer-kafka-supervisor-hjelfmnc-1, groupId=kafka-supervisor-hjelfmnc] Fetch position FetchPosition{offset=144333390, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-1.kafka-headless.druid.svc.cluster.local:9092 (id: 1 rack: null)], epoch=0}} is out of range for partition druid-0, raising error to the application since no reset policy is configured
2023-01-16T08:38:51,734 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - OffsetOutOfRangeException with message [Fetch position FetchPosition{offset=144333390, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-1.kafka-headless.druid.svc.cluster.local:9092 (id: 1 rack: null)], epoch=0}} is out of range for partition druid-0]
2023-01-16T08:38:51,734 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - Retrying in 30000ms
  • s
    This message was deleted.
    b
    • 2
    • 2
  • s
    This message was deleted.
    a
    • 2
    • 1
  • s
    This message was deleted.
    a
    b
    d
    • 4
    • 7
  • a
    Initially, without creating static looup In coordinator log, we could see below messages after every 2 mins 2023-01-17T043923,100 INFO [LookupCoordinatorManager--0] org.apache.druid.server.lookup.cache.LookupCoordinatorManager - Not updating lookups because no data exists 2023-01-17T044123,100 INFO [LookupCoordinatorManager--0] org.apache.druid.server.lookup.cache.LookupCoordinatorManager - Not updating lookups because no data exists But once the lookup is created, I could see the lookup not found exception error if we open the lookup immediately { "type": "map", "map": { "a": "alpha", "b": "beta" } } After some time, we could see the values. I don’t see the ‘ Not updating lookups because no data exists‘ log being logged anymore but nothing related lookup is getting logged after that. One more thing is if I update anything in the lookup , there is nothing being logged in the coordinator or broker or router related to it though the lookup get updated
  • d
    Hi, When i ingest a table into druid, i see duplicate records. Exact same row is ingested twice
  • d
    Here is the screenshot
  • s
    This message was deleted.
    p
    d
    s
    • 4
    • 36
  • d
    please let me know what is going wrong. Source data is always correct
  • s
    This message was deleted.
    i
    b
    a
    • 4
    • 8
  • s
    This message was deleted.
    b
    d
    • 3
    • 7
  • s
    This message was deleted.
    v
    b
    • 3
    • 34
  • b
    java.lang.IllegalArgumentException: Cannot construct instance of `org.apache.druid.segment.loading.L...
  • d
    Hi all! Curious about an issue I'm running into where 
    null
    values are stripped from multivalue fields when ingesting json data. Couldn't find anything in the documentation about this behavior so I filed a ticket here. Figured I'd open up the discussion here as well, thanks so much!
  • m
    Hi i have problem with authorizer
  • s
    This message was deleted.
    t
    m
    • 3
    • 17
  • m
  • s
    This message was deleted.
    👀 1
    t
    l
    v
    • 4
    • 8
  • s
    This message was deleted.
    b
    b
    m
    • 4
    • 7
  • s
    Hi All Seeing a weird issue with druid historical the segment is expected to be replicated to 2 nodes as per retention rules but there are few segments which were replicated to most of the nodes and occupying huge storage Any ideas on what could have been wrong ?
  • s
    For eg : we have tiers (hot and cold) 2022-01-12 is expected to be in hot But it is available in cold and replicated almost to 36 cold historical nodes
  • v
    what is your retention rule?
  • s
    Last 3 months on hot and beyond that to cold
  • s
    This message was deleted.
    s
    s
    v
    • 4
    • 41
  • s
    we are seeing this issue after switching from tranquility to kinesis ingestion
1...151617...53Latest