controller.conf

controller.data.dir=<s3://bucket-name/pinot-data/pinot-quickstart/controller-data>
controller.local.temp.dir=/tmp/pinot-tmp-data/
controller.zk.str=<zk endpoint>:2181
controller.host=<controller IP>
controller.port=9000
controller.helix.cluster.name=pinot-quickstart
pinot.controller.storage.factory.class.s3=org.apache.pinot.plugin.filesystem.S3PinotFS
pinot.controller.storage.factory.s3.region=us-east-1

pinot.controller.segment.fetcher.protocols=file,http,s3
pinot.controller.segment.fetcher.s3.class=org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher
pinot.controller.storage.factory.s3.disableAcl=false

error:

ryanclark@DESKTOP-3TVB8KH apache-pinot-incubating-0.7.1-bin % bin/pinot-admin.sh StartController -configFileName controller.conf
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/lib/pinot-all-0.7.1-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-file-system/pinot-s3/pinot-s3-0.7.1-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See <http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pinot.spi.plugin.PluginClassLoader (file:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/lib/pinot-all-0.7.1-jar-with-dependencies.jar) to method java.net.URLClassLoader.addURL(java.net.URL)
WARNING: Please consider reporting this to the maintainers of org.apache.pinot.spi.plugin.PluginClassLoader
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Executing command: StartController -configFileName controller.conf
Executing command: StartServiceManager -clusterName PinotCluster -zkAddress localhost:2181 -port -1 -bootstrapServices []
Starting a Pinot [SERVICE_MANAGER] at 0.037s since launch
Registering service status handler
Skip Starting Pinot Service Manager admin application
Started Pinot [SERVICE_MANAGER] instance [ServiceManager_10.0.0.213_-1] at 0.056s since launch
Starting a Pinot [CONTROLLER] at 0.056s since launch
Trying to start Pinot Controller...
Initialized FunctionRegistry with 119 functions: [fromepochminutesbucket, arrayunionint, codepoint, mod, sha256, year, yearofweek, upper, arraycontainsstring, arraydistinctstring, bytestohex, tojsonmapstr, trim, timezoneminute, sqrt, togeometry, normalize, fromepochdays, arraydistinctint, exp, jsonpathlong, yow, toepochhoursrounded, lower, toutf8, concat, ceil, todatetime, jsonpathstring, substr, dayofyear, contains, jsonpatharray, arrayindexofint, fromepochhoursbucket, arrayindexofstring, minus, arrayunionstring, toepochhours, toepochdaysrounded, millisecond, fromepochhours, arrayreversestring, dow, doy, min, toepochsecondsrounded, strpos, jsonpath, tosphericalgeography, fromepochsecondsbucket, max, reverse, hammingdistance, stpoint, abs, timezonehour, toepochseconds, arrayconcatint, quarter, md5, ln, toepochminutes, arraysortstring, replace, strrpos, jsonpathdouble, stastext, second, arraysortint, split, fromepochdaysbucket, lpad, day, toepochminutesrounded, fromdatetime, fromepochseconds, arrayconcatstring, base64encode, ltrim, arraysliceint, chr, sha, plus, base64decode, month, arraycontainsint, toepochminutesbucket, startswith, week, jsonformat, sha512, arrayslicestring, fromepochminutes, remove, dayofmonth, times, hour, rpad, arrayremovestring, now, divide, bigdecimaltobytes, floor, toepochsecondsbucket, toepochdaysbucket, hextobytes, rtrim, length, toepochhoursbucket, bytestobigdecimal, toepochdays, arrayreverseint, datetrunc, minute, round, dayofweek, arrayremoveint, weekofyear] in 414ms
Starting Pinot controller in mode: DUAL.
Registering metricsRegistry to listener org.apache.pinot.common.metrics.JmxReporterMetricsRegistryRegistrationListener
Number of metrics registry: 0
Number of listeners got registered: 1
Registering JmxReporterMetricsRegistryRegistrationListener
Number of metrics in metricsRegistry: 0
Initializing global 25 meters
Initializing global 19 gauges
Starting Helix controller
Starting ZkClient event thread.
Client environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT
Client environment:host.name=10.0.0.213
Client environment:java.version=11.0.11
Client environment:java.vendor=AdoptOpenJDK
Client environment:java.home=/Users/ryanclark/Library/Java/JavaVirtualMachines/adopt-openjdk-11.0.11/Contents/Home
Client environment:java.class.path=/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/lib/pinot-all-0.7.1-jar-with-dependencies.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-file-system/pinot-gcs/pinot-gcs-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-file-system/pinot-adls/pinot-adls-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-file-system/pinot-s3/pinot-s3-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-file-system/pinot-hdfs/pinot-hdfs-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/pinot-batch-ingestion-hadoop-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/pinot-batch-ingestion-standalone-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/pinot-batch-ingestion-spark-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-protobuf/pinot-protobuf-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-orc/pinot-orc-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-csv/pinot-csv-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-confluent-avro/pinot-confluent-avro-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-parquet/pinot-parquet-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-avro/pinot-avro-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-json/pinot-json-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-input-format/pinot-thrift/pinot-thrift-0.7.1-shaded.jar:/Users/ryanclark/apache-pinot-incubating-0.7.1-bin/plugins/pinot-stream-ingestion/pinot-kafka-2.0/pinot-kafka-2.0-0.7.1-shaded.jar
Client environment:java.library.path=/Users/ryanclark/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
Client environment:java.io.tmpdir=/var/folders/q6/7tb5ffbj621_wtx7wvf2pwmm0000gn/T/
Client environment:java.compiler=<NA>
Client environment:os.name=Mac OS X
Client environment:os.arch=x86_64
Client environment:os.version=10.15.7
Client environment:user.name=ryanclark
Client environment:user.home=/Users/ryanclark
Client environment:user.dir=/Users/ryanclark/apache-pinot-incubating-0.7.1-bin
Client environment:os.memory.free=4046MB
Client environment:os.memory.max=8192MB
Client environment:os.memory.total=4096MB
Initiating client connection, connectString=<zk endpoint>:2181 sessionTimeout=30000 watcher=org.apache.helix.manager.zk.client.ZkConnectionManager@2189e7a7
Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
jute.maxbuffer value is 4194304 Bytes
zookeeper.request.timeout value is 0. feature enabled=
Opening socket connection to server <zk endpoint>/<zk endpoint>:2181. Will not attempt to authenticate using SASL (unknown error)

I got the

<zk endpoint>

from the `service/pinot-zookeeper`:

ryanclark@Ryan-Clarks-MacBook-Pro incubator-pinot % kubectl describe service/pinot-zookeeper -n pinot-quickstart
Name:              pinot-zookeeper
Namespace:         pinot-quickstart
Labels:            app=zookeeper
                   <http://app.kubernetes.io/managed-by=Helm|app.kubernetes.io/managed-by=Helm>
                   chart=zookeeper-2.1.6
                   heritage=Helm
                   release=pinot
Annotations:       <http://meta.helm.sh/release-name|meta.helm.sh/release-name>: pinot
                   <http://meta.helm.sh/release-namespace|meta.helm.sh/release-namespace>: pinot-quickstart
Selector:          app=zookeeper,release=pinot
Type:              ClusterIP
IP Families:       <none>
IP:                redacted
IPs:               <none>
Port:              client  2181/TCP
TargetPort:        client/TCP
Endpoints:         <zk endpoint>:2181
Session Affinity:  None
Events:            <none>

There's a line about starting ServiceManager with a localhost address which is probably not what I want:

Executing command: StartServiceManager -clusterName PinotCluster -zkAddress localhost:2181 -port -1 -bootstrapServices []

My suspicion is that zookeeper started up fine on a valid IP but pinot was started pointing at localhost for zookeeper as you comment above indicates

Your suspicion makes sense. But also, I have no problem ingesting a stream, so I thought zookeeper was set up correctly.

@User What should the

controller.zk.str

be for a kubernetes deployment?

isn’t it a k8s pod?

if your zookeeper is on remote aws eks, but you want to run pinot on your local laptop, then it will be an issue, as your local desktop has no way to DNS resolution on a K8s cluster

you can either do port-forwarding from k8s to your local and use

localhost:<port>

to connector to zk

or you deploy pinot to your k8s cluster as well

This

bin/pinot-admin.sh StartController -configFileName controller.conf -controllerHost <http://a6076865cb5c64e408b39c2bbb7978e2-1091345406.us-east-1.elb.amazonaws.com|a6076865cb5c64e408b39c2bbb7978e2-1091345406.us-east-1.elb.amazonaws.com> -controllerPort 9000 -clusterName pinot-quickstart

returns

Error: option "-configFileName" cannot be used with the option(s) [-controllerHost, -controllerPort, -dataDir, -zkAddress, -clusterName, -controllerMode]

E.g. This is one example

➜ kt get configMaps pinot-live-controller-config -n pinot-live -o yaml
apiVersion: v1
data:
  pinot-controller.conf: |-
    controller.helix.cluster.name=pinot-quickstart
    controller.port=9000
    controller.data.dir=/var/pinot/controller/data
    controller.zk.str=pinot-live-zookeeper:2181
    pinot.set.instance.id.to.hostname=true
    controller.task.scheduler.enabled=true
kind: ConfigMap
metadata:
  creationTimestamp: "2021-05-10T20:52:23Z"
  managedFields:
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:data:
        .: {}
        f:pinot-controller.conf: {}
    manager: Go-http-client
    operation: Update
    time: "2021-05-10T20:52:23Z"
  name: pinot-live-controller-config
  namespace: pinot-live
  resourceVersion: "650909"
  selfLink: /api/v1/namespaces/pinot-live/configmaps/pinot-live-controller-config
  uid: 4b15ac7f-c4f1-40ee-ba3a-b7522809d783

then refer to that file in your helm

btw, I don’t think set controller host to

<http://a6076865cb5c64e408b39c2bbb7978e2-1091345406.us-east-1.elb.amazonaws.com|a6076865cb5c64e408b39c2bbb7978e2-1091345406.us-east-1.elb.amazonaws.com>

is the right way

and using the created external loadbalancer

or just deploy pinot helm in a new namespace

but you may have multiple controllers

default controller host should be pinot-controller-0, pinot-controller-1, etc

k8s will handle service routing