Yes surely

From this blog.. https://engineering.linkedin.com/blog/2019/auto-tuning-pinot

Do you think your data as scope for aggregation on the fly?

As in incoming events with duplicate dimensions?

Yes v need that for future

I’ll look at why auto tuning is recommending such tiny segments

Cc @Neha Pawar ^^

V will also re run the utility , could be that with our initial understanding, v did not provide the right data to utility..

Data with different dimensions and v surely need queries that should aggregate over those different dimensions

I'm working on a layer that joins MySQL and Pinot data that requires interactive latencies (<100ms). I've been trying to use Presto for this but I haven't found configurations that make this scale well (Presto is not designed for interactive latencies). I'll dive deeper into Presto soon to see where the issues are (e.g. are the connectors causing requests to be executed serially?). What other ways people join Pinot and other data sources?

query time joins are unpredictable and hard to achieve low latency

is there possibility of pre-join?

Like denormalize the data out of Pinto? Yes, it's an option. Not ideal since there would be a delay to the stats.

Usually, I'll be joining like 100 rows from MySQL with Pinot aggregate stats.

These are not big joins.

Presto just has a bunch of overhead (even for small queries)

ah, is this more for decoration?

I'm not sure I understand 'decoration'. It's more that most of the query result sizes will be small and I can prevent the views if they are large. I currently do a

MySQL left join Pinot

to add Pinot stats onto other entities.

What is the name of the function in pinot to get the current timestamp, i.e. is it

now()

or is there a magic constant like

current_timestamp

?

now()

Thanks! Is it newer than 0.3.0?

yes

dont know if it will be part of 0.4.0

@Xiang Fu @Haibo Wang

it’s part of 0.4.0

Nice!

now()

Sorry, 1 more question, we found a workaround but need to convert a double to an int in pinot calcite sql, is there a way?

example