Shen Wan
09/10/2020, 9:20 PMfunctionName
should I use? And also how should I decide the numPartitions
?Adrian Cole
09/14/2020, 5:06 AMOliver
09/14/2020, 9:59 AMJoey Pereira
09/15/2020, 5:20 AMinstanceId=pinot-broker-1
and that looks like it did some "fun" things!
The server's instance zk state is
{
"id": "pinot-broker-1",
"simpleFields": {
"HELIX_ENABLED": "true",
"HELIX_ENABLED_TIMESTAMP": "1600146975179",
"HELIX_HOST": "pinot-broker-1",
"HELIX_PORT": ""
},
"mapFields": {},
"listFields": {
"TAG_LIST": [
"DefaultTenant_BROKER"
]
}
}
Based on a bit of splunking, it looks like the instanceId
has to conform to a strict form of <type>_<hostname>_<port>
for internals to work?udk
09/15/2020, 4:24 PMWill Briggs
09/18/2020, 5:50 PMpinot-broker-0
pod is constantly spamming warnings into the log, because there is no zookeeper running:
2020/09/18 17:48:20.691 WARN [ClientCnxn] [Start a Pinot [BROKER]-SendThread(pinot-zookeeper.pinot-quickstart.svc.cluster.local:2181)] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
Buchi Reddy
09/18/2020, 6:24 PMShen Wan
09/18/2020, 7:14 PMBuchi Reddy
09/21/2020, 7:12 PMShen Wan
09/22/2020, 8:05 PMcolumns.psf
? It’s a file ~300M.Dharak Kharod
09/23/2020, 2:11 AMSashikanth Damaraju
09/23/2020, 10:24 PMdocker logs -f <controller_container_id>
doesn't show anything relevant to the 400Raghav
09/24/2020, 4:38 PMAdam Haines
09/26/2020, 3:23 PMAdrian Cole
09/28/2020, 12:08 AMAdrian Cole
09/28/2020, 4:40 AMHunter E
09/28/2020, 7:52 PMSandishKumarHN
09/29/2020, 7:01 PM[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ pinot-spark-connector ---
[INFO] /Users/sandishkumarhn/git/incubator-pinot/pinot-connectors/pinot-spark-connector/src/main/scala:-1: info: compiling
[INFO] Compiling 16 source files to /Users/sandishkumarhn/git/incubator-pinot/pinot-connectors/pinot-spark-connector/target/classes at 1601397499238
[ERROR] java.lang.NoClassDefFoundError: scala/reflect/internal/Trees
[INFO] at java.lang.Class.getDeclaredMethods0(Native Method)
[INFO] at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
[INFO] at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
[INFO] at java.lang.Class.getMethod0(Class.java:3018)
[INFO] at java.lang.Class.getMethod(Class.java:1784)
[INFO] at scala_maven_executions.MainHelper.runMain(MainHelper.java:155)
[INFO] at scala_maven_executions.MainWithArgsInFile.main(MainWithArgsInFile.java:26)
Prakash Tirumalareddy
10/01/2020, 3:44 AMShane Fitzroy
10/01/2020, 5:17 AMIgor Lema
10/01/2020, 1:19 PMWojtek Sznapka
10/05/2020, 7:18 AMrow_number over (partition by ticket_number order by source.lsn DESC)
which numbers rows with the 1 as the newest and then we look for rows numbers = 1 in sub-query (BQ docs). How would you solve it in Pinot, I didn't find windowing/analytic functions. Thanks in advance!Prakash Tirumalareddy
10/05/2020, 2:23 PMCaused by: java.lang.IllegalArgumentException: Parameter 'Bucket' must not be null
I am using 0.5.0
GenerationJobRunner,
segmentTarPushJobRunnerClassName: org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner,
segmentUriPushJobRunnerClassName: org.apache.pinot.plugin.ingestion.batch.standalone.SegmentUriPushJobRunner}
includeFileNamePattern: glob:**/*.parquet
inputDirURI: s3://edp-pinot-data/nem13/
jobType: SegmentCreationAndUriPush
outputDirURI: s3://edp-pinot-segments/nem13/segments
overwriteOutput: true
pinotClusterSpecs:
- {controllerURI: 'http://localhost:9000'}
pinotFSSpecs:
- {className: org.apache.pinot.spi.filesystem.LocalPinotFS, configs: null, scheme: file}
- className: org.apache.pinot.plugin.filesystem.S3PinotFS
configs: {region: ap-southeast-2}
scheme: s3
pushJobSpec: {pushAttempts: 1, pushParallelism: 1, pushRetryIntervalMillis: 1000,
segmentUriPrefix: 's3://edp-pinot-segments', segmentUriSuffix: null}
recordReaderSpec: {className: org.apache.pinot.plugin.inputformat.parquet.ParquetRecordReader,
configClassName: null, configs: null, dataFormat: parquet}
segmentNameGeneratorSpec: null
tableSpec: {schemaURI: 'http://localhost:9000/tables/nem13/schema', tableConfigURI: 'http://localhost:9000/tables/nem13',
tableName: nem13}
Am I missing anything? Please help!!!Neha Pawar
Vinu Thomas
10/07/2020, 5:54 PMVinu Thomas
10/09/2020, 10:41 AMBuchi Reddy
10/09/2020, 5:45 PMCesar
10/09/2020, 10:46 PMalec goldis
10/11/2020, 5:16 PMAdrian Cole
10/12/2020, 5:05 AM