This message was deleted Apache Druid #general

Join Slack

This message was deleted.

# general

Slackbot

07/20/2023, 5:30 PM

This message was deleted.

Sergio Ferragut

07/20/2023, 5:54 PM

I have not used this contributor extension, but what I'm understanding is that it is meant to continuously run to maintain the view as data is loaded into its base data source. You need to query it using a

"queryType": "view"

. What is your expectation?

José Ambrosio Hernández Molina

07/20/2023, 6:28 PM

My expectation is to create a materialized view based on a data source that I already have loaded in druid, then I want to consult certain data from that source where I use lookups and convert that query into a materialized view, with the fields that I am going to need, that is my goal

Sergio Ferragut

07/20/2023, 6:36 PM

Have you tried querying it with

"queryType":"view"

? then maybe loading more data into the base table and re-query to see the effect of the RUNNING supervisor?

José Ambrosio Hernández Molina

07/20/2023, 6:38 PM

I will try what you tell me

José Ambrosio Hernández Molina

07/20/2023, 6:48 PM

l run this

curl -H 'Content-Type:application/json' -d @my_view_query_sql.json http://<host>:<port>/druid/v2

where my query.json is:

Copy code

{
  "queryType": "view",
  "query": {
    "queryType": "sql",
    "dataSource": "sales",
    "intervals": [
      "2022-09-12/2023-09-13"
    ],
    "query": "SELECT country, SUM(sales) AS total FROM sales GROUP BY country ORDER BY total DESC LIMIT 10"
  }
}

I'm having this error: `{"error":"Unknown exception","errorMessage":"Please make sure to load all the necessary extensions and jars with type 'view' on 'druid/router' service. Could not resolve type id 'view' as a subtype of
org.apache.druid.query.Query
known type ids = [dataSourceMetadata, groupBy, scan, search, segmentMetadata, select, timeBoundary, timeseries, topN, windowOperator]\n at [Source:` and verify that I have the extensions loaded correctly, I don't know what other configuration I am missing.

Sergio Ferragut

07/20/2023, 7:04 PM

I don't think if this extension supports SQL queries. I think you'll need to use the JSON payload as described in the example. Notice that the note on the "query" field says "query must be groupBy, topN, or timeseries type."

José Ambrosio Hernández Molina

07/20/2023, 7:15 PM

change the query.json file like this:

Copy code

{
  "queryType": "view",
  "query": {
    "queryType": "groupBy",
    "dataSource": "ventas",
    "granularity": "all",
    "dimensions": [
      "AREA"
    ],
    "limitSpec": {
      "type": "default",
      "limit": 1,
      "columns": [
        {
          "dimension": "tickets",
          "direction": "descending",
          "dimensionOrder": "numeric"
        }
      ]
    },
    "aggregations": [
      {
        "type": "longSum",
        "name": "tickets",
        "fieldName": "tickets"
      }
    ],
    "intervals": [
      "2020-09-12/2023-09-13"
    ]
  }
}

and I have the same error: `{"error":"Unknown exception","errorMessage":"Please make sure to load all the necessary extensions and jars with type 'view' on 'druid/router' service. Could not resolve type id 'view' as a subtype of

org.apache.druid.query.Query

known type ids = [dataSourceMetadata, groupBy, scan, search, segmentMetadata, select, timeBoundary, timeseries, topN, windowOperator]\n at [Source: (org.eclipse.jetty.server.HttpInputOverHTTP); line: 1, column: 25]","errorClass":"com.fasterxml.jackson.databind.exc.InvalidTypeIdException","host":null}`

Sergio Ferragut

07/20/2023, 8:05 PM

Oh… given that it is a contrib extension, the jars are not pre-loaded. Here’s some info on how to do that https://druid.apache.org/docs/latest/operations/pull-deps.html

👀 1

Open in Slack

Previous Next