Hi group! I wanted to check whether Druid can quer...
# general
d
Hi group! I wanted to check whether Druid can query Iceberg tables directly without ingesting the data first. Are there any plans to support this capability in the future? Thank you.
b
Not currently. There have been discussions about functionality like that in the future, but nothing is currently on the roadmap that I am aware of.
👍 1
r
I'm using duckdb + URL pre-signed proxy to access druid data as HTTP streaming So in my app I have something like: const url = await this.dataflowApiService.getGenericQueryAutorizedUrl({ query:
Copy code
SELECT ... FROM GL_03_MSGS WHERE
__time >= MILLIS_TO_TIMESTAMP(CAST(? as BIGINT)) -- Query start time
AND __time < MILLIS_TO_TIMESTAMP(CAST(? as BIGINT))  -- Query end time
, autoParams: queryParams, asStream: true, context: { timeout: 60000 * 10, priority: 10, // Set some higher priority for this query }, timezone: 'UTC', resultFormat: 'csv', withHeaders: 'columns', }); // Create raw_events table and load data from CSV await db.all(
Copy code
CREATE TABLE raw_events AS
    SELECT * FROM read_csv_auto('${url}', header = true, delim = ',');
); // Then inside duckdb, you can connect/ merge/ etc with postgres/iceberg
🙌 1