<@UDRJ7G85T> maybe also because i set REFRESH as s...
# generald
Damiano
04/28/2020, 9:53 PM@User maybe also because i set REFRESH as segmentPushType so i read with this setting i cannot append directly. it is just a copy of the data i want to query...without the possibility to add new data
k
Kishore G
04/28/2020, 9:55 PM
There are two modes, REFRESH and APPEND (default). In APPEND mode you can keep pushing new data. In Refresh mode, every time you push data, you replace existing data
d
Damiano
04/28/2020, 9:57 PMok, so basically now what is a fast way to put data inside my test table? at the moment the data is on a CSV
k
Kishore G
04/28/2020, 9:59 PM
run this command - https://docs.pinot.apache.org/getting-started/pushing-your-data-to-pinot
d
Damiano
04/28/2020, 10:02 PMawesome! thank you so much
Damiano
04/28/2020, 10:04 PMi am not using a timestamp, i have read that it is mandatory only for append
Damiano
04/28/2020, 10:23 PM😮 😮 inserting 37M records in few seconds
Damiano
04/28/2020, 10:23 PMwow
Damiano
04/28/2020, 10:27 PMselect max(amount) from test group by strategy_id limit 7895, 25 ( i have ~ 8000 strategies ) "timeUsedMs": 974 !! yes it is a simple query but 37M of records! i do not think the docker version is tuned, no?
Damiano
04/28/2020, 10:27 PMi think it has the default configuration
Damiano
04/28/2020, 10:32 PMoh i think yes bercause reading the trace i am seeing:
Damiano
04/28/2020, 10:32 PM"numServersQueried": 1,"numServersResponded": 1,"numSegmentsQueried": 1,"numSegmentsProcessed": 1,"numSegmentsMatched": 1,Damiano
04/28/2020, 10:32 PMdo it is using just one partition/segment
k
Kishore G
04/28/2020, 10:49 PM
lets use #C011C9JHN7R channel
👍 1