Jinwei Zhu
12/02/2020, 8:37 PMNeha Pawar
Jinwei Zhu
12/02/2020, 10:54 PM{
"code": 500,
"error": "org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata"
}
Neha Pawar
"stream.kafka.broker.list": "localhost:9876",
according to your kafka clusterJinwei Zhu
12/02/2020, 10:58 PMhelm install -n pinot-quickstart kafka incubator/kafka --set replicas=1
Neha Pawar
kubectl get all
?Jinwei Zhu
12/02/2020, 11:06 PMNAME READY STATUS RESTARTS AGE
pod/kafka-0 1/1 Running 0 46m
pod/kafka-zookeeper-0 1/1 Running 0 46m
pod/kafka-zookeeper-1 1/1 Running 0 46m
pod/kafka-zookeeper-2 1/1 Running 0 45m
pod/pinot-broker-0 1/1 Running 1 50m
pod/pinot-controller-0 1/1 Running 0 50m
pod/pinot-server-0 1/1 Running 1 50m
pod/pinot-server-1 1/1 Running 1 50m
pod/pinot-zookeeper-0 1/1 Running 0 50m
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/kafka ClusterIP 10.102.3.210 <none> 9092/TCP 46m
service/kafka-headless ClusterIP None <none> 9092/TCP 46m
service/kafka-zookeeper ClusterIP 10.108.54.111 <none> 2181/TCP 46m
service/kafka-zookeeper-headless ClusterIP None <none> 2181/TCP,3888/TCP,2888/TCP 46m
service/pinot-broker ClusterIP 10.107.199.233 <none> 8099/TCP 50m
service/pinot-broker-external LoadBalancer 10.96.55.75 <pending> 8099:30241/TCP 50m
service/pinot-broker-headless ClusterIP None <none> 8099/TCP 50m
service/pinot-controller ClusterIP 10.105.81.75 <none> 9000/TCP 50m
service/pinot-controller-external LoadBalancer 10.107.192.144 <pending> 9000:32385/TCP 50m
service/pinot-controller-headless ClusterIP None <none> 9000/TCP 50m
service/pinot-server ClusterIP 10.109.0.248 <none> 8098/TCP 50m
service/pinot-server-headless ClusterIP None <none> 8098/TCP 50m
service/pinot-zookeeper ClusterIP 10.108.40.150 <none> 2181/TCP 50m
service/pinot-zookeeper-headless ClusterIP None <none> 2181/TCP,3888/TCP,2888/TCP 50m
NAME READY AGE
statefulset.apps/kafka 1/1 46m
statefulset.apps/kafka-zookeeper 3/3 46m
statefulset.apps/pinot-broker 1/1 50m
statefulset.apps/pinot-controller 1/1 50m
statefulset.apps/pinot-server 2/2 50m
statefulset.apps/pinot-zookeeper 1/1 50m
Neha Pawar
Jinwei Zhu
12/03/2020, 1:24 AMNeha Pawar
Jinwei Zhu
12/03/2020, 1:57 AMkubectl -n pinot-quickstart exec kafka-0 -- kafka-console-consumer --bootstrap-server kafka:9092 --topic transcript-topic --from-beginning
and the responds shows WARN [Consumer clientId=consumer-1, groupId=console-consumer-65502] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
Xiang Fu
/tmp/pinot-quick-start/rawData/transcript.json
in your local or on that containerJinwei Zhu
12/03/2020, 2:10 AMkubectl -n pinot-quickstart cp /tmp/pinot-quick-start/rawData/transcript.json kafka-0:/tmp/transcript.json
to copy that file and then kubectl -n pinot-quickstart exec kafka-0 -- kafka-console-producer --broker-list kafka:9092 --topic transcript-topic < /tmp/transcript.json
but got -bash: /tmp/transcript.json: No such file or directoryXiang Fu
kubectl -n pinot-quickstart exec -it kafka-0 -- bash
to enter into the container to do jobJinwei Zhu
12/03/2020, 7:57 PMXiang Fu