This message was deleted.
# troubleshooting
s
This message was deleted.
l
are you talking about segment granularity or query granularity? Is this a rollup? Any logs, specs or screenshots to share?
s
what is difference between query granularity & segment granularity?
l
segment granularity is the time range of your segments, each of them might cover a day of data, an hour, a month… a segment should store up to a few million records. You’ll set this in ‘Partition’ tab. when you’re doing a rollup, you decide how big is going to be the chunks each row will summarize, thats query granularity. You set this in ‘Configure Schema’ tab, usually when you’re doing a rollup. So you can create a table with hourly segment granularity, stored in segments with daily or weekly granulariy.
s
So, If I have to keep my data summarized to 1 minute level, I will do it in query granularity. And segment is like physical partition of this data stored.
l
So you can create a table with hourly segment query granularity, stored in segments with daily or weekly granulariy.
just to make sure as I noticed an error
yeah, it makes sense to summarize your raw data into minute-level rows, stored in hourly or daily segments. so when you run a query for a time range, druid will know which segments might have your data, so no reason to check in every segment.
s
Thanks!
Going back to original question, reindexing from druid data source into another, I am missing summary of metrics. All are showing as 0
b
This happens if the original datasource has no rollup. The reindex doesn't have rollup to rollup, I guess. Here are some steps I found about getting around it:
Since the original ingestion was done without rollup or defining metrics, reindexing with rollup enabled did not find any metrics to aggregate, which is why it shows null/zero. Solution: In the Re-Indexing spec, the metrics from the original datasource can be specified as part of the inputSource spec, via something like:
Copy code
"inputSource": {
    "type": "druid",
    "metrics": [
      "m1"        <--=============---
    ],
    "dataSource": "orig",
    "interval": "2000/3000"
  }
If using the web console, the UI presents the option to specify metrics during the "connect" step (default is empty). The "m1" metric can be added thereto generate the correct spec. After adding the "m1" metric, I'm able to query the reindexed data source and see the expected (non-zero) values for the sum_m1 column.
That would be in the ioConfig section, btw
s
Thanks it worked!!
b
awesome!