Công Anh
11/03/2022, 3:15 AMMark Herrera
11/03/2022, 4:39 PMIgor Berman
11/03/2022, 7:16 PMKrzysztof Klimonda
11/03/2022, 9:21 PMAshok Kumar Ragupathi
11/04/2022, 6:05 AMSourav Saraf
11/04/2022, 8:12 AMMBM
11/04/2022, 9:29 AMCarl
11/04/2022, 5:48 PMJW Sun
11/06/2022, 12:59 AM2022-11-06T00:54:37,807 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[115,646] and (estimated) bytes[1,431,528,932]
2022-11-06T00:55:07,380 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data for segment[faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2] spill[25] to disk in [29,573] ms (115,646 rows).
2022-11-06T00:55:08,384 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data with commit metadata [null] for segments: faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2
2022-11-06T00:55:08,384 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted stats: processed rows: [13072926], persisted rows[115646], sinks: [1], total fireHydrants (across sinks): [26], persisted fireHydrants (across sinks): [1]
2022-11-06T00:55:29,570 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushing in-memory data to disk because (estimated) bytesCurrentlyInMemory[1431664710] is greater than maxBytesInMemory[1431655765].
2022-11-06T00:55:29,571 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[115,642] and (estimated) bytes[1,431,536,366]
2022-11-06T00:55:58,724 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data for segment[faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2] spill[26] to disk in [29,151] ms (115,642 rows).
2022-11-06T00:55:59,614 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data with commit metadata [null] for segments: faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2
2022-11-06T00:55:59,614 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted stats: processed rows: [13186468], persisted rows[115642], sinks: [1], total fireHydrants (across sinks): [27], persisted fireHydrants (across sinks): [1]
2022-11-06T00:56:20,396 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushing in-memory data to disk because (estimated) bytesCurrentlyInMemory[1431662514] is greater than maxBytesInMemory[1431655765].
2022-11-06T00:56:20,397 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[115,646] and (estimated) bytes[1,431,533,158]
2022-11-06T00:56:50,289 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data for segment[faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2] spill[27] to disk in [29,892] ms (115,646 rows).
2022-11-06T00:56:51,162 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data with commit metadata [null] for segments: faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2
2022-11-06T00:56:51,163 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted stats: processed rows: [13303921], persisted rows[115646], sinks: [1], total fireHydrants (across sinks): [28], persisted fireHydrants (across sinks): [1]
2022-11-06T00:57:11,877 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushing in-memory data to disk because (estimated) bytesCurrentlyInMemory[1431662606] is greater than maxBytesInMemory[1431655765].
2022-11-06T00:57:11,878 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[115,648] and (estimated) bytes[1,431,532,238]
2022-11-06T00:57:41,633 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data for segment[faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2] spill[28] to disk in [29,755] ms (115,648 rows).
2022-11-06T00:57:42,591 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushed in-memory data with commit metadata [null] for segments: faa03180-ca6a-46b4-9f8c-bce9b53df66b_2019-02-01T00:00:00.000Z_2019-03-01T00:00:00.000Z_2022-11-05T23:06:32.277Z_2
2022-11-06T00:57:42,591 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted stats: processed rows: [13416581], persisted rows[115648], sinks: [1], total fireHydrants (across sinks): [29], persisted fireHydrants (across sinks): [1]
2022-11-06T00:58:04,847 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Flushing in-memory data to disk because (estimated) bytesCurrentlyInMemory[1431664132] is greater than maxBytesInMemory[1431655765].
2022-11-06T00:58:04,848 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Persisted rows[115,645] and (estimated) bytes[1,431,532,752]
2022-11-06T00:58:34,434 INFO [[index_parallel_faa03180-ca6a-46b4-9f8c-bce9b53df66b_nlmclekj_2022-11-05T23:06:32.242Z]-appenderator-persist] org.apache.druid.segment.realtime.appen
Abdel
11/06/2022, 1:51 PMJohn Jeffers
11/07/2022, 2:09 AMdruid.discovery.k8s.clusterIdentifier
in one of my clusters. Is it safe to change that value or is that going to break everything?Sachidananda Maharana
11/07/2022, 4:01 PMCarl
11/07/2022, 7:28 PMSachidananda Maharana
11/08/2022, 3:53 PM"indexSpec is not ready: [spec].\nTrying the next indexSpec.
I checked there is no lock present in mysql for this interval and it is fully available i.e. all segments are loaded
after trying some changes in spec when i put
"forceTimeChunkLock": false
result is success
So I am thinking there is some lock present for this interval in zk.
Any inputs here will help me a lotCarl
11/08/2022, 7:13 PMJason Koch
11/08/2022, 10:59 PMswetha
11/09/2022, 2:29 AMFelipe Gonzalez
11/09/2022, 11:30 PMPHP Dev
11/13/2022, 4:17 PMMBM
11/15/2022, 11:50 AMJose Robles
11/16/2022, 12:37 AMextensions-core
directory to contain our Pravega extension/plugin. We currently are working to get an end to end process flow starting with reading from Pravega and then writing to Druid. We were wondering if there were any examples/documentation that we could be pointed towards to help us transform these read data streams from Pravega so that they are compatible with Apache DruidDimitar
11/16/2022, 2:56 PMVadim
11/21/2022, 11:45 PMVadim
11/21/2022, 11:52 PMGian Merlino
11/22/2022, 7:15 PMCarl
11/22/2022, 8:32 PMkfaraz
11/23/2022, 5:00 AMAbhishek Agarwal
11/23/2022, 11:15 AMReena Leone
11/23/2022, 3:07 PMArthur Sherman
11/23/2022, 9:25 PM