Slackbot
12/06/2023, 3:04 AMJohn Kowtko
12/06/2023, 3:37 AMVamsi Gandrapu
12/06/2023, 3:53 AMVamsi Gandrapu
12/06/2023, 4:57 AMdruid.indexer.runner.type=httpRemote so MM’s are used, not sure if this has any bearing as I noticed lot of faulty channel exceptions with workorder post requests?Laksh Singla
12/06/2023, 7:28 AMVamsi Gandrapu
12/06/2023, 7:34 PM{"maxNumTasks": 4,"includeSegmentSource": "REALTIME"}
INSERT into foo
with domain1 as (select max(__time) as lastUpdatedAt, latest("domain1.dim1") as domain1_dim1, .... from "stream.table" where domain='domain1' group by domain1_id),
with domain2 as (select max(__time) as lastUpdatedAt, latest("domain2.dim1") as domain2_dim1, .... from "stream.table" where domain='domain2' group by domain2_id),
....
select domain1_dim1, domain2_dim1 from domain2 left join domain1 on (domain2.id=domain1.id) group by <all_dimensions> PARTITIONED BY DAY
CLUSTERED BY domain2_idVamsi Gandrapu
12/06/2023, 7:41 PMLaksh Singla
12/07/2023, 5:31 AMVamsi Gandrapu
12/07/2023, 10:00 PMINSERT into foo
with domain1 as (select max(__time) as lastUpdatedAt, latest("domain1.dim1",64) as domain1_dim1, .... from "stream.table" where domain='domain1' group by domain1_id),
with domain2 as (select max(__time) as lastUpdatedAt, latest("domain2.dim1",64) as domain2_dim1, .... from "stream.table" where domain='domain2' group by domain2_id),
....
select domain1_dim1, domain2_dim1 from domain2 left join domain1 on (domain2.id=domain1.id) group by <all_dimensions> PARTITIONED BY DAY
CLUSTERED BY domain2_idLaksh Singla
12/08/2023, 5:18 AMLaksh Singla
12/08/2023, 5:20 AMLaksh Singla
12/08/2023, 5:20 AMdomain1_id
What is this key? (expression and the column type)Vamsi Gandrapu
12/12/2023, 3:24 PMsql-native and returns 1 expected result in ~3secs, and executed the same with sql-msq-task, and the task completes in ~55s with no results. join’s seem to be working fine.Vamsi Gandrapu
12/12/2023, 5:17 PM“includeSegmentSource”: “REALTIME” set in the context. Also, noticing the same query succeeds at times with results and intermittently returns no results (with task succeeding though).