Bharat Thakur
01/11/2023, 12:14 PMBharat Thakur
01/11/2023, 12:20 PMBharat Thakur
01/11/2023, 12:20 PMVijay Narayanan
01/11/2023, 12:27 PMVijay Narayanan
01/11/2023, 12:27 PMIgor Berman
01/12/2023, 7:06 AMPawel Rzepinski
01/12/2023, 9:23 AM{
"queryType": "timeseries",
"dataSource": {
"type": "query",
"query": {
"queryType": "groupBy",
"dataSource": "site_traffic",
"intervals": [
"0000/3000"
],
"granularity": "all",
"dimensions": [
"page"
],
"aggregations": [
{
"type": "count",
"name": "hits"
}
]
}
},
"intervals": [
"0000/3000"
],
"granularity": "all",
"aggregations": [
{
"type": "longSum",
"name": "hits",
"fieldName": "hits"
},
{
"type": "count",
"name": "pages"
}
],
"postAggregations": [
{
"type": "expression",
"name": "average_hits_per_page",
"expression": "hits / pages"
}
]
}
Can context
field be provided on both timeseries
(outer query) and groupBy
level (inner query) or only on timeseries
?SClark
01/12/2023, 9:28 AMVijay Narayanan
01/12/2023, 11:56 AMVijay Narayanan
01/12/2023, 12:01 PMHeiner
01/12/2023, 1:51 PM2023-01-12T13:42:02,474 ERROR [sql[c5caf449-b396-4867-bba3-b3bf98c54516]] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [4ca4e189-058a-4122-8f36-5457c9c914d0] (org.apache.druid.query.QueryCapacityExceededException: Cannot acquire 1 merge buffers. Try again after current running queries are finished.)
Kaushik
01/12/2023, 3:32 PMKonstantin Minevskiy
01/12/2023, 5:05 PMpartitionSpec
using the hashed
type, but I’m seeing task failures for partial_index_generate
subtask type (this is the second phase for this parallel task, according to this reference):
ERROR [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Exception while running task[AbstractTask{id='partial_index_generate_datasource_joddfjfc_2023-01-12T16:40:40.201Z', groupId='index_parallel_datasource_fnikekoj_2023-01-12T16:36:16.962Z', taskResource=TaskResource{availabilityGroup='partial_index_generate_datasource_joddfjfc_2023-01-12T16:40:40.201Z', requiredCapacity=1}, dataSource='datasource', context={forceTimeChunkLock=true}}]
org.apache.druid.java.util.common.ISE: Failed to get shardSpec for interval[2022-12-10T00:00:00.000-05:00/2022-12-11T00:00:00.000-05:00]
at org.apache.druid.indexing.common.task.ShardSpecs.getShardSpec(ShardSpecs.java:57) ~[druid-indexing-service-0.21.0.jar:0.21.0]
The same task spec, but with dynamic
partitioning and forceGuaranteedRollup: true
completes successfully though.
I could only find a few mentions of shardSpec
in Druid’s mailing list, but it doesn’t look like official docs have any info on it.Pramod Immaneni
01/12/2023, 10:34 PMBharat Thakur
01/13/2023, 6:43 AMBharat Thakur
01/13/2023, 6:43 AMVaibhav Malik
01/13/2023, 7:37 PMorg.apache.druid.firehose.PostgresqlFirehoseDatabaseConnector
, problem: java.lang.ClassNotFoundException: org.postgresql.Driver. I've seen in the documentation that the postgresql-metadata-storage extension which gives Druid the ability to ingest data from a postgresql database relies on SqlFirehouse which is no longer supported in the latest release. Is there a new method for ingesting postgresql data? We've verified that the postgresql jars are loaded into the correct folders and that the postgresql-metadata-storage extension is loaded as well. Thanks 👍tilak chowdary
01/14/2023, 10:15 PMUnknownError: java.lang.RuntimeException: java.lang.RuntimeException: org.apache.druid.java.util.common.ISE: Unable to handle type[ARRAY<STRING>] for AggregatorFactory[class org.apache.druid.query.aggregation.ExpressionLambdaAggregatorFactory]
Brandon Tan
01/15/2023, 1:52 AMSundeep Kumar Mehta
01/15/2023, 6:51 PMSundeep Kumar Mehta
01/15/2023, 6:53 PMSundeep Kumar Mehta
01/15/2023, 6:55 PMSundeep Kumar Mehta
01/15/2023, 6:56 PMArav K
01/15/2023, 11:43 PMdruid_zk.service_enabled: false
druid_serverview_type: http
druid_coordinator_loadqueuepeon_type: http
druid_indexer_runner_type: httpRemote
druid_discovery_type: k8s
druid_discovery_k8s_clusterIdentifier : druid
druid_discovery_k8s_podNameEnvKey : POD_NAME
druid_discovery_k8s_podNamespaceEnvKey : POD_NAMESPACE
Sachidananda
01/16/2023, 4:45 AMBharat Thakur
01/16/2023, 7:03 AMVijay Narayanan
01/16/2023, 7:24 AMBharat Thakur
01/16/2023, 7:35 AMBharat Thakur
01/16/2023, 7:35 AMBharat Thakur
01/16/2023, 7:35 AM