We will update to 3 controllers. In general do you...
# troubleshootinge
Elon
06/09/2020, 12:39 AMWe will update to 3 controllers. In general do you scale brokers to handle qps and scale the servers as the data grows?
x
Xiang Fu
06/09/2020, 2:53 AM
In general yes, QPS growth may also require more data replications which end up increasing more servers
e
Elon
06/09/2020, 2:53 AMThanks! Is that both the
replicationreplicasPerPartitionx
Xiang Fu
06/09/2020, 3:46 AM
yes. replicasPerPartition should be used only for realtime @Neha Pawar please confirm
👍 1
n
Neha Pawar
06/09/2020, 4:10 PM
Yes, replicasPerPartition for real time
👍 1
s
srisudha
06/11/2020, 1:25 AMHow does the increased replicas of controllers work? I increased the controller replicas to 3 and m getting an error. Meanwhile if i look at the file shares in azure i see data only on one PV storage.. Other two controllers have blank
...
e
Elon
06/11/2020, 1:25 AMCan you paste the controller config?
Elon
06/11/2020, 1:25 AMMight be something similar to us, we use gcs pinot fs.
s
srisudha
06/11/2020, 1:26 AMeception : Caused by: org.apache.pinot.spi.utils.retry.RetriableOperationException: org.apache.pinot.common.exception.HttpErrorStatusException: Got error status code: 404 (Not Found) with reason
srisudha
06/11/2020, 1:27 AMwhile searching for segment its 404
e
Elon
06/11/2020, 1:27 AMCould be the class you are using, can you paste the config for the controller?
s
srisudha
06/11/2020, 1:28 AMyes 1 moment
srisudha
06/11/2020, 1:42 AMapiVersion: v1
kind: ConfigMap
metadata:
name: controller-config
namespace: {{ .Values.namespace }}
data:
pinot-controller.conf: |-
controller.helix.cluster.name={{ .Values.cluster.name }}
controller.port={{ .Values.controller.port }}
controller.vip.host={{ include "pinot.controller.fullname" . }}
controller.vip.port={{ .Values.controller.service.port }}
controller.data.dir={{ .Values.controller.data.dir }}
controller.zk.str={{ include "zookeeper.url" . }}
pinot.set.instance.id.to.hostname=true
pinot.controller.enable.split.commit=true
e
Elon
06/11/2020, 1:38 PMI think you need to set the segment fetcher classes:
Elon
06/11/2020, 1:39 PM Copy code
pinot.controller.storage.factory.class.azure={{ .Values.azure.factoryClass }}
pinot.controller.segment.fetcher.protocols={{ .Values.azure.fetcher.protocols }}
pinot.controller.segment.fetcher.azure.class={{ .Values.azure.fetcher.class }}