Ravi Singal
04/16/2020, 5:41 PMXiang Fu
Damiano
04/29/2020, 11:59 AMKishore G
Damiano
04/30/2020, 7:57 AMDan Hill
05/01/2020, 2:08 AM1) Configuration property 'pinot.infer-date-type-in-schema' was not used
2) Configuration property 'pinot.infer-timestamp-type-in-schema' was not used
Xiang Fu
--memory="1g" --cpus=".5"
in docker run
commandDamiano
05/03/2020, 4:04 PMSubbu Subramaniam
05/05/2020, 1:43 AMNeha Pawar
Ranveer Singh
05/05/2020, 5:27 PMJack
05/06/2020, 5:32 PMNeha Pawar
2020/05/07 08:56:29.835 INFO [SegmentIndexCreationDriverImpl] [main] Finished building StatsCollector!
2020/05/07 08:56:29.836 INFO [SegmentIndexCreationDriverImpl] [main] Collected stats for 36000000 documents
2020/05/07 08:56:29.859 INFO [SegmentDictionaryCreator] [main] Created dictionary for INT column: m1 with cardinality: 49, range: 1 to 49
2020/05/07 08:56:29.875 INFO [SegmentDictionaryCreator] [main] Created dictionary for INT column: m2 with cardinality: 64000, range: 0 to 63999
2020/05/07 08:56:29.879 INFO [SegmentDictionaryCreator] [main] Created dictionary for LONG column: count with cardinality: 1, range: 1 to 1
2020/05/07 08:56:29.884 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d1, size: 11
2020/05/07 08:56:29.884 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d1 with cardinality: 1, max length in bytes: 11, range: ucdmJUDhdcv to ucdmJUDhdcv
2020/05/07 08:56:29.888 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d2, size: 200000
2020/05/07 08:56:29.889 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d2 with cardinality: 8000, max length in bytes: 25, range: A to zzltgSI
2020/05/07 08:56:29.897 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d3, size: 570000
2020/05/07 08:56:29.898 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d3 with cardinality: 38000, max length in bytes: 15, range: A to zzzqDAvrzsUvncL
2020/05/07 08:56:29.899 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d4, size: 16
2020/05/07 08:56:29.899 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d4 with cardinality: 4, max length in bytes: 4, range: Is to o
2020/05/07 08:56:29.900 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d5, size: 910
2020/05/07 08:56:29.900 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d5 with cardinality: 35, max length in bytes: 26, range: BHYTfkbxibsOoZYRInA to ysLZeqUdcMzWRYlWueR
2020/05/07 08:56:29.901 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d6, size: 27
2020/05/07 08:56:29.901 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d6 with cardinality: 3, max length in bytes: 9, range: GNhWQNwor to a
2020/05/07 08:56:29.902 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d7, size: 35
2020/05/07 08:56:29.902 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d7 with cardinality: 5, max length in bytes: 7, range: MlMtQ to z
2020/05/07 08:56:29.902 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d8, size: 15
2020/05/07 08:56:29.903 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d8 with cardinality: 5, max length in bytes: 3, range: cLf to x
2020/05/07 08:56:29.903 INFO [SegmentDictionaryCreator] [main] Using fixed bytes value dictionary for column: d9, size: 4553
2020/05/07 08:56:29.904 INFO [SegmentDictionaryCreator] [main] Created dictionary for STRING column: d9 with cardinality: 157, max length in bytes: 29, range: A to zwaGwwzPkH
2020/05/07 08:56:32.072 INFO [SegmentDictionaryCreator] [main] Created dictionary for LONG column: timestamp with cardinality: 29441824, range: 1587366000002 to 1587452399994
2020/05/07 08:56:32.148 INFO [SegmentIndexCreationDriverImpl] [main] Start building IndexCreator!
2020/05/07 08:59:05.704 INFO [SegmentIndexCreationDriverImpl] [main] Finished records indexing in IndexCreator!
2020/05/07 08:59:05.787 INFO [SegmentIndexCreationDriverImpl] [main] Finished segment seal!
Kishore G
Dan Hill
05/09/2020, 5:22 AMDamiano
05/09/2020, 5:37 PMprotected IntermediateResultsBlock getNextBlock() <--- here?
Damiano
05/11/2020, 10:21 AMsrisudha
05/20/2020, 5:52 PMJackie
05/21/2020, 6:06 PMbrokerResource
2020/05/21 16:35:04.476 WARN [ConfigAccessor] [ZkClient-EventThread-27-zookeeper.test.svc.cluster.local:2181/pinot] No config found at /test-views/CONFIGS/RESOURCE/brokerResource
Kishore G
select playerID,league playerName, sum(hits) from baseballStats group by playerID, league, playerName
select league,playerID, playerName, sum(hits) from baseballStats group by league,playerID, playerName
srisudha
05/23/2020, 1:44 AMDan Hill
05/24/2020, 4:58 PMDan Hill
05/24/2020, 6:25 PMQuery 20200524_182130_00003_5izra failed: <http://java.net|java.net>.UnknownHostException: pinot-broker-0.pinot-broker-headless.pinot-metrics-dev.svc.cluster.local: Name or service not known
Kishore G
Dan Hill
06/02/2020, 12:13 AMjava.lang.RuntimeException: entry size '14879990781' is too big ( > 8589934591 )
at org.apache.commons.compress.archivers.tar.TarArchiveOutputStream.failForBigNumber(TarArchiveOutputStream.java:623) ~[pinot-all-0.4.0-SNAPSHOT-jar-with-dependencies.jar:0.4.0-SNAPSHOT-ed26e8589fe5f91d2876d417aebf23575010cc76]
Logskish
06/03/2020, 10:54 PMKishore G
pinot.broker.timeoutMs
Xiang Fu
sudo docker run --rm -ti -e JAVA_OPTS="-Xms8G -Dlog4j2.configurationFile=/opt/pinot/conf/pinot-admin-log4j2.xml -Dplugins.dir=/opt/pinot/plugins" -v /home/ec2-user/metrics:/home/ec2-user/metrics -v /home/ec2-user/events:/home/ec2-user/events --name pinot-data-ingestion-job apachepinot/pinot:latest LaunchDataIngestionJob -jobSpecFile ~/metrics/pinot/loadtest/kubernetes/aws-dev-batch-job-spec.yaml
Xiang Fu